lush.ca
robots.txt

Robots Exclusion Standard data for lush.ca

Resource Scan

Scan Details

Site Domain lush.ca
Base Domain lush.ca
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-04-06T23:15:42+00:00
Next Scan 2025-07-05T23:15:42+00:00

Last Successful Scan

Scanned2023-09-06T00:21:33+00:00
URL https://www.lush.ca/robots.txt
Domain IPs 104.16.229.85, 104.16.230.85
Response IP 104.16.229.85
Found Yes
Hash 88aa24521c70249678b035dc947f634d95357d81302c37b441fdcb4bc08ab12d
SimHash 41aece7ced0b

Groups

dotbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

springbot

Rule Path
Disallow /

pinterestbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 0.2

*

Rule Path
Disallow /*?q=*
Disallow /*pmid%3D*
Disallow /*prefv1%3D*
Disallow /*prefv2%3D*
Disallow /*prefv3%3D*
Disallow /*prefn1%3D*
Disallow /*prefn2%3D*
Disallow /*prefn3%3D*
Disallow /*/404*
Disallow /*/account*
Disallow /*/add-address
Disallow /*/cart
Disallow /*/checkout*
Disallow /*/edit-password*
Disallow /*/order-confirmation*
Disallow /*/pivot*
Disallow /search
Disallow /*/search*
Disallow /search?q=*
Disallow /search?search-button
Disallow /search?search-button*
Disallow /static/on/demandware.store*
Disallow /on/demandware.store*
Disallow /*/subscriptions/
Disallow /*/wishlist/
Disallow /write-review*
Disallow /checkout-login
Disallow /quiz/haircare/*
Disallow /email-products-1
Disallow /email-products-2
Disallow /email-footer
Allow /*/carte
Allow /on/demandware.store/*/Default-Start

Other Records

Field Value
sitemap https://www.lush.ca/sitemap_index.xml

Comments

  • lush.ca robots.txt
  • last updated: 2023-04-05