andrewbcarroll.com
robots.txt

Robots Exclusion Standard data for andrewbcarroll.com

Resource Scan

Scan Details

Site Domain andrewbcarroll.com
Base Domain andrewbcarroll.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-03-22T00:35:03+00:00
Next Scan 2025-06-20T00:35:03+00:00

Last Successful Scan

Scanned2022-11-09T14:27:55+00:00
URL https://www.andrewbcarroll.com/robots.txt
Response IP 104.18.136.62, 104.18.134.62, 104.18.132.62, 104.18.133.62, 104.18.135.62
Found Yes
Hash 1d5f26af1550bdc44e23b6b6160277005ffaa43f7b80e635516050fbf27d2fa9
SimHash 113cd620d0c2

Groups

nerdybot

Rule Path
Disallow /

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 60

bubing

Rule Path
Disallow /