borgataconcerts.com
robots.txt

Robots Exclusion Standard data for borgataconcerts.com

Resource Scan

Scan Details

Site Domain borgataconcerts.com
Base Domain borgataconcerts.com
Scan Status Ok
Last Scan2025-12-11T10:05:06+00:00
Next Scan 2025-12-18T10:05:06+00:00

Last Scan

Scanned2025-12-11T10:05:06+00:00
URL https://borgataconcerts.com/robots.txt
Domain IPs 104.21.8.97, 172.67.157.70, 2606:4700:3031::6815:861, 2606:4700:3034::ac43:9d46
Response IP 172.67.157.70
Found Yes
Hash 97d7dd497387d4f857f6009c1e5cbeddb12e68686025bf58062bbcd40f2f0d06
SimHash f41ed462aa8a

Groups

dataforseobot
petalbot
mj12bot
amazonbot

Rule Path
Disallow /

meta-externalagent
dotbot
ahrefsbot
semrushbot
siteauditbot
bytespider
mj12bot
baiduspider
yandexbot
sogou
l9explore

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20