crumlinunited.com
robots.txt

Robots Exclusion Standard data for crumlinunited.com

Resource Scan

Scan Details

Site Domain crumlinunited.com
Base Domain crumlinunited.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-09-22T10:39:01+00:00
Next Scan 2025-12-21T10:39:01+00:00

Last Successful Scan

Scanned2025-02-02T10:35:49+00:00
URL https://crumlinunited.com/robots.txt
Domain IPs 104.21.24.74, 172.67.217.198, 2606:4700:3031::6815:184a, 2606:4700:3035::ac43:d9c6
Response IP 104.21.24.74
Found Yes
Hash b0b899a3c2d95ce8f75ee09e3dad4159ee9f2376a754f4052dc35c5c71b244b5
SimHash 69194c45c793

Groups

*

Rule Path
Disallow
Disallow /cgi-bin/

Other Records

Field Value
sitemap https://uncannyvinyl.com/sitemap.xml