robindavis.com
robots.txt

Robots Exclusion Standard data for robindavis.com

Resource Scan

Scan Details

Site Domain robindavis.com
Base Domain robindavis.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan5/11/2025, 3:52:31 AM
Next Scan 7/10/2025, 3:52:31 AM

Last Successful Scan

Scanned3/13/2025, 3:11:40 AM
URL https://robindavis.com/robots.txt
Domain IPs 104.21.13.189, 172.67.133.16, 2606:4700:3033::6815:dbd, 2606:4700:3033::ac43:8510
Response IP 104.21.13.189
Found Yes
Hash 81a7a5bd29da5a7ffda473f23d4ae5ee6b2cbe5af67982723d7f36de1b99e81f
SimHash 94015d040310

Groups

*

Rule Path
Disallow /cgi-bin
Disallow /images
Disallow /admin