urbandecay.ca
robots.txt

Robots Exclusion Standard data for urbandecay.ca

Resource Scan

Scan Details

Site Domain urbandecay.ca
Base Domain urbandecay.ca
Scan Status Ok
Last Scan2024-05-25T20:59:58+00:00
Next Scan 2024-06-24T20:59:58+00:00

Last Scan

Scanned2024-05-25T20:59:58+00:00
URL https://urbandecay.ca/robots.txt
Redirect https://www.urbandecay.ca/robots.txt
Redirect Domain www.urbandecay.ca
Redirect Base urbandecay.ca
Domain IPs 104.18.42.49, 172.64.145.207, 2606:4700:4400::6812:2a31, 2606:4700:4400::ac40:91cf
Redirect IPs 104.18.42.49, 172.64.145.207, 2606:4700:4400::6812:2a31, 2606:4700:4400::ac40:91cf
Response IP 104.18.42.49
Found Yes
Hash d24a324859a3e4fa8c0ce322498a450baec928310ad7e456956d05ea877e933e
SimHash 4729f067c9d0

Groups

*

Rule Path
Disallow */cart*
Disallow */COCheckout-Show
Disallow */my-account
Disallow */addresses
Disallow */COCheckout-Show
Disallow */Loyalty-Dashboard
Disallow */Loyalty-Referral
Disallow */Loyalty-Activity
Disallow */order-history
Disallow */payment-types
Disallow */wishlist
Disallow */order-status*
Disallow */order-history*
Disallow /*search*
Disallow /*?start*
Disallow /*prefv1%3D*
Disallow /*prefn1%3D*
Disallow /*404*
Disallow *bvstate*
Disallow */on/demandware.store*
Disallow /*Newsletter*
Disallow /*Page-Show*
Disallow /*?q=*

googlebot

Rule Path
Allow .js
Allow .css

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.urbandecay.ca/sitemap_0.xml