davesite.com
robots.txt

Robots Exclusion Standard data for davesite.com

Resource Scan

Scan Details

Site Domain davesite.com
Base Domain davesite.com
Scan Status Ok
Last Scan2026-01-09T08:22:21+00:00
Next Scan 2026-01-16T08:22:21+00:00

Last Scan

Scanned2026-01-09T08:22:21+00:00
URL https://davesite.com/robots.txt
Domain IPs 104.21.59.39, 172.67.212.156, 2606:4700:3032::ac43:d49c, 2606:4700:3035::6815:3b27
Response IP 172.67.212.156
Found Yes
Hash 6288dde2996947fa48d1dd7de610bc66852ec0e288a275a3f8b44c6883d5b7f2
SimHash 2938dcc0c3b2

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 60