roadsidethoughts.com
robots.txt

Robots Exclusion Standard data for roadsidethoughts.com

Resource Scan

Scan Details

Site Domain roadsidethoughts.com
Base Domain roadsidethoughts.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-08T10:41:59+00:00
Next Scan 2025-07-07T10:41:59+00:00

Last Successful Scan

Scanned2023-12-16T10:37:09+00:00
URL https://roadsidethoughts.com/robots.txt
Domain IPs 104.26.10.15, 104.26.11.15, 172.67.73.234, 2606:4700:20::681a:a0f, 2606:4700:20::681a:b0f, 2606:4700:20::ac43:49ea
Response IP 104.26.11.15
Found Yes
Hash cc31e661d7ff6a05cb1330efc701fbf4105911cb6d175495c31dbbe2a436e24a
SimHash 6d554444c593

Groups

*

Rule Path
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://roadsidethoughts.com/sitemap.xml