myscrapchick.com
robots.txt

Robots Exclusion Standard data for myscrapchick.com

Resource Scan

Scan Details

Site Domain myscrapchick.com
Base Domain myscrapchick.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-31T11:19:07+00:00
Next Scan 2025-06-29T11:19:07+00:00

Last Successful Scan

Scanned2024-11-09T10:45:57+00:00
URL https://myscrapchick.com/robots.txt
Domain IPs 104.21.14.166, 172.67.160.17, 2606:4700:3031::ac43:a011, 2606:4700:3033::6815:ea6
Response IP 104.21.14.166
Found Yes
Hash 88f448d90449c53152e17238be623730db150b15a4463237fe16cbefb59d6a90
SimHash 9155d0024152

Groups

mj12bot

Rule Path
Disallow /