bustybus.com
robots.txt

Robots Exclusion Standard data for bustybus.com

Resource Scan

Scan Details

Site Domain bustybus.com
Base Domain bustybus.com
Scan Status Ok
Last Scan2024-09-09T13:57:23+00:00
Next Scan 2024-10-09T13:57:23+00:00

Last Scan

Scanned2024-09-09T13:57:23+00:00
URL https://bustybus.com/robots.txt
Domain IPs 104.21.59.68, 172.67.217.153, 2606:4700:3031::6815:3b44, 2606:4700:3037::ac43:d999
Response IP 172.67.217.153
Found Yes
Hash 5e111b0d79fd1e8a0a30ff354e3da79380eb0ee9e4a69bb217076f6707fb0cba
SimHash 3b10dc07eb31

Groups

*

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

semrushbot-si

Rule Path
Disallow /

semrushbot-swa

Rule Path
Disallow /

semrushbot-ct

Rule Path
Disallow /

semrushbot-bm

Rule Path
Disallow /

Other Records

Field Value
sitemap https://bustybus.com/sitemap.xml

Comments

  • www.robotstxt.org/
  • www.google.com/support/webmasters/bin/answer.py?hl=en&answer=156449

Warnings

  • `host` is not a known field.