colorsmith.eu
robots.txt

Robots Exclusion Standard data for colorsmith.eu

Resource Scan

Scan Details

Site Domain colorsmith.eu
Base Domain colorsmith.eu
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-17T08:37:53+00:00
Next Scan 2025-07-16T08:37:53+00:00

Last Successful Scan

Scanned2024-04-12T08:33:08+00:00
URL https://colorsmith.eu/robots.txt
Redirect https://www.colorsmith.co/robots.txt
Redirect Domain www.colorsmith.co
Redirect Base colorsmith.co
Domain IPs 104.18.39.13, 172.64.148.243
Redirect IPs 104.16.142.117, 104.16.143.117
Response IP 104.16.143.117
Found Yes
Hash 279d13090024bb713583104f5dd807dc6325600084bdd19c6d1e83f09bd535fd
SimHash 67048d40ca11

Groups

*

Rule Path
Disallow /users/
Disallow /domain_toggle
Disallow /profile
Disallow /checkout/
Disallow /my_account/
Disallow /lp/
Disallow /cdn-cgi/

pinterest

Rule Path
Disallow /users/
Disallow /domain_toggle
Disallow /profile
Disallow /checkout/
Disallow /my_account/
Disallow /lp/
Disallow /cdn-cgi/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.colorsmith.co/sitemap.xml