bobbystuff.com
robots.txt

Robots Exclusion Standard data for bobbystuff.com

Resource Scan

Scan Details

Site Domain bobbystuff.com
Base Domain bobbystuff.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-10-17T16:28:09+00:00
Next Scan 2026-01-15T16:28:09+00:00

Last Successful Scan

Scanned2024-06-25T05:36:04+00:00
URL https://bobbystuff.com/robots.txt
Domain IPs 2600:4c00:400:4::103, 67.222.31.241
Response IP 67.222.31.241
Found Yes
Hash f1961c3f74924d5a79779255eb0e367383e08c8977872868aaa454951dc44c2d
SimHash 6518d454e331

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5