clothworks.com
robots.txt

Robots Exclusion Standard data for clothworks.com

Resource Scan

Scan Details

Site Domain clothworks.com
Base Domain clothworks.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-11-29T20:08:35+00:00
Next Scan 2026-02-27T20:08:35+00:00

Last Successful Scan

Scanned2023-10-19T01:31:02+00:00
URL https://clothworks.com/robots.txt
Domain IPs 172.66.40.82, 172.66.43.174, 2606:4700:3108::ac42:2852, 2606:4700:3108::ac42:2bae
Response IP 172.66.40.82
Found Yes
Hash 65b448a1257c74fc7463d0d93fdd7b7297a54a9c5be4b6b4d2ad69e6572ca417
SimHash 65085c574591

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 20

Other Records

Field Value
sitemap https://clothworks.com/sitemap.xml