boysintheband.com
robots.txt

Robots Exclusion Standard data for boysintheband.com

Resource Scan

Scan Details

Site Domain boysintheband.com
Base Domain boysintheband.com
Scan Status Ok
Last Scan2024-09-14T09:40:18+00:00
Next Scan 2024-10-14T09:40:18+00:00

Last Scan

Scanned2024-09-14T09:40:18+00:00
URL https://boysintheband.com/robots.txt
Domain IPs 69.57.162.22
Response IP 69.57.162.22
Found Yes
Hash 1fbd4bed6aa672fb11b7b23d4a44662e009005d868888baf383a649d39918286
SimHash 18189f12e822

Groups

ahrefssiteaudit

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

semrushbot-seoab

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mbcrawler/1.0

Rule Path
Disallow /

Other Records

Field Value
sitemap https://boysintheband.com/sitemap_index.xml