colorsmith.es
robots.txt

Robots Exclusion Standard data for colorsmith.es

Resource Scan

Scan Details

Site Domain colorsmith.es
Base Domain colorsmith.es
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-17T08:41:55+00:00
Next Scan 2025-07-16T08:41:55+00:00

Last Successful Scan

Scanned2024-04-12T08:36:34+00:00
URL https://colorsmith.es/robots.txt
Redirect https://www.colorsmith.co/robots.txt
Redirect Domain www.colorsmith.co
Redirect Base colorsmith.co
Domain IPs 104.18.38.85, 172.64.149.171
Redirect IPs 104.16.142.117, 104.16.143.117
Response IP 104.16.142.117
Found Yes
Hash 279d13090024bb713583104f5dd807dc6325600084bdd19c6d1e83f09bd535fd
SimHash 67048d40ca11

Groups

*

Rule Path
Disallow /users/
Disallow /domain_toggle
Disallow /profile
Disallow /checkout/
Disallow /my_account/
Disallow /lp/
Disallow /cdn-cgi/

pinterest

Rule Path
Disallow /users/
Disallow /domain_toggle
Disallow /profile
Disallow /checkout/
Disallow /my_account/
Disallow /lp/
Disallow /cdn-cgi/

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.colorsmith.co/sitemap.xml