myawesomedoggy.com
robots.txt

Robots Exclusion Standard data for myawesomedoggy.com

Resource Scan

Scan Details

Site Domain myawesomedoggy.com
Base Domain myawesomedoggy.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-07-08T12:22:50+00:00
Next Scan 2024-10-06T12:22:50+00:00

Last Successful Scan

Scanned2023-09-10T08:04:35+00:00
URL https://www.myawesomedoggy.com/robots.txt
Domain IPs 172.233.218.191
Response IP 199.59.243.224
Found Yes
Hash ac7feb4e52fd6b99a1cbde3f2c2c375ba9f263aec80d992ca333ade3c91f4866
SimHash a12ada40c3b3

Groups

*

Rule Path
Allow /
Disallow /?*
Disallow /_zc

Other Records

Field Value
crawl-delay 120