dallasrestaurants.com
robots.txt

Robots Exclusion Standard data for dallasrestaurants.com

Resource Scan

Scan Details

Site Domain dallasrestaurants.com
Base Domain dallasrestaurants.com
Scan Status Ok
Last Scan2025-05-01T08:06:44+00:00
Next Scan 2025-05-08T08:06:44+00:00

Last Scan

Scanned2025-05-01T08:06:44+00:00
URL https://dallasrestaurants.com/robots.txt
Redirect https://www.dallasrestaurants.com/robots.txt
Redirect Domain www.dallasrestaurants.com
Redirect Base dallasrestaurants.com
Domain IPs 104.21.84.77, 172.67.188.167
Redirect IPs 104.21.84.77, 172.67.188.167
Response IP 172.67.188.167
Found Yes
Hash 4b68f232e2236b006f30d009da94be5fa72cbd85120aa095a23d17103a316da9
SimHash 9850d7026e91

Groups

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

voltron

Rule Path
Disallow /

bender

Rule Path
Disallow /

gort

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

piplbot

Rule Path
Disallow /

*

Rule Path
Allow /

Warnings

  • 2 invalid lines.