lancome-usa.com
robots.txt
Robots Exclusion Standard data for lancome-usa.com
Resource Scan
Scan Details
| Site Domain | lancome-usa.com |
| Base Domain | lancome-usa.com |
| Scan Status | Ok |
| Last Scan | 2024-09-09T19:39:38+00:00 |
| Next Scan | 2024-10-09T19:39:38+00:00 |
Last Scan
| Scanned | 2024-09-09T19:39:38+00:00 |
| URL | https://lancome-usa.com/robots.txt |
| Redirect | https://www.lancome-usa.com/robots.txt |
| Redirect Domain | www.lancome-usa.com |
| Redirect Base | lancome-usa.com |
| Domain IPs | 104.18.41.242, 172.64.146.14, 2606:4700:4400::6812:29f2, 2606:4700:4400::ac40:920e |
| Redirect IPs | 104.18.41.242, 172.64.146.14, 2606:4700:4400::6812:29f2, 2606:4700:4400::ac40:920e |
| Response IP | 104.18.41.242 |
| Found | Yes |
| Hash | d14207b244f525d315299ba31ccf1f1529d91d336506e1a938ed23511ad1a8d5 |
| SimHash | b325567ca777 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */account |
| Disallow | */Account |
| Disallow | */Address |
| Disallow | */Blog |
| Disallow | */cart |
| Disallow | */Cart |
| Disallow | */Generic |
| Disallow | */GiftRegistry |
| Disallow | */Lancome-RefinementsShow |
| Disallow | */homepage |
| Disallow | */LancomeHelper |
| Disallow | */Login |
| Disallow | */My-Lancome |
| Disallow | */Order |
| Disallow | */order |
| Disallow | */Page |
| Disallow | */Product-Show |
| Disallow | */Product-Variation |
| Disallow | */Promo |
| Disallow | */register |
| Disallow | */Reviews-SubmitFeedback |
| Disallow | */sample |
| Disallow | */samples |
| Disallow | */Search-Show |
| Disallow | */search?q |
| Disallow | */SendToFriend |
| Disallow | */shopping-bag |
| Disallow | */Stores-Find |
| Disallow | */Wishlist |
| Disallow | */wishlist |
| Allow | /dw/shop/ |
| Allow | /search?fdid= |
| Disallow | /*prefn1%3D |
| Disallow | /*prefn2%3D |
| Disallow | /*prefn3%3D |
| Disallow | /*prefn4%3D |
| Disallow | /*prefv1%3D |
| Disallow | /*prefv2%3D |
| Disallow | /*prefv3%3D |
| Disallow | /*prefv4%3D |
| Disallow | /*subid%3D |
| Disallow | /*pmax%3D |
| Disallow | /*pmin%3D |
| Disallow | /*start%3D |
| Disallow | /*cgid%3D |
| Disallow | /*sz%3D |
| Disallow | /*format%3D |
| Disallow | /*gclid%3D |
| Disallow | /*linksrc%3D |
| Disallow | /*variantID%3D |
| Disallow | /*crefn1%3D |
| Disallow | /*dwvar |
| Disallow | /*start |
| Disallow | /*ranEAID |
| Disallow | /*bvstate |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 5 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.lancome-usa.com/sitemap_index.xml |