lancome.ca
robots.txt

Robots Exclusion Standard data for lancome.ca

Resource Scan

Scan Details

Site Domain lancome.ca
Base Domain lancome.ca
Scan Status Ok
Last Scan2024-11-16T16:05:37+00:00
Next Scan 2024-12-16T16:05:37+00:00

Last Scan

Scanned2024-11-16T16:05:37+00:00
URL https://lancome.ca/robots.txt
Redirect https://www.lancome.ca/robots.txt
Redirect Domain www.lancome.ca
Redirect Base lancome.ca
Domain IPs 104.18.36.170, 172.64.151.86, 2606:4700:4400::6812:24aa, 2606:4700:4400::ac40:9756
Redirect IPs 104.18.36.170, 172.64.151.86, 2606:4700:4400::6812:24aa, 2606:4700:4400::ac40:9756
Response IP 104.18.36.170
Found Yes
Hash a165f2c9a2f9df8e64b7153c2478ac182c8648677eb2d5ae38810907259af579
SimHash 681419132b9a

Groups

*

Rule Path
Disallow /cart
Disallow /account
Disallow /register
Disallow /customer-service
Disallow *search?
Disallow /demandware.store/Sites-lancome-ca-Site/
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/Wishlist-Add
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/Wishlist-AddFavorite
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/SendToFriend-Start
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/Reviews-SubmitFeedback
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/Login-OAuthLogin
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/Account-PasswordResetDialog
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/Product-Variation
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/Order-Details
Disallow /en/shareandearn.html
Disallow /fr/shareandearn.html
Disallow /en/welcome-page.html
Disallow /fr/welcome-page.html
Disallow /en/email-exact-target-form.html
Disallow /fr/email-exact-target-form.html
Disallow /en/giftcertpurchase
Disallow /fr/giftcertpurchase
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/TrackOrder-Show
Disallow /on/demandware.store/Sites-lancome-ca-Site/fr_CA/TrackOrder-Show
Disallow /en/orders
Disallow /fr/orders
Disallow /en/profile
Disallow /fr/profile
Disallow /en/sitemap
Disallow /fr/sitemap
Disallow /en/wishlist
Disallow /fr/wishlist
Disallow /en/addressbook
Disallow /fr/addressbook
Disallow /on/demandware.store/Sites-lancome-ca-Site/en_CA/Lancome-PaymentInstruments
Disallow /on/demandware.store/Sites-lancome-ca-Site/fr_CA/Lancome-PaymentInstruments
Disallow *?start
Disallow *?pmax
Disallow *?dwvar
Disallow *?csort
Disallow *bvroute
Disallow *bvstate

Other Records

Field Value
crawl-delay 5

Other Records

Field Value
sitemap https://www.lancome.ca/sitemap_index.xml