us.lorealprofessionnel.com
robots.txt
Robots Exclusion Standard data for us.lorealprofessionnel.com
Resource Scan
Scan Details
Site Domain | us.lorealprofessionnel.com |
Base Domain | lorealprofessionnel.com |
Scan Status | Ok |
Last Scan | 2024-06-21T13:44:26+00:00 |
Next Scan | 2024-07-05T13:44:26+00:00 |
Last Scan
Scanned | 2024-06-21T13:44:26+00:00 |
URL | https://us.lorealprofessionnel.com/robots.txt |
Domain IPs | 104.18.74.228, 104.18.75.228, 2606:4700::6812:4ae4, 2606:4700::6812:4be4 |
Response IP | 104.18.75.228 |
Found | Yes |
Hash | 4005ef7bdf3e1cadd4f9e8210cf44f00ee150795a2947a23587c4bbfad77073b |
SimHash | 3a8d3a344d32 |
Groups
*
Rule | Path |
---|---|
Disallow | /sitecore |
Disallow | */api/popin/ |
Disallow | */api/productsearch/ |
Disallow | */api/popin/Video/ |
Disallow | /sitecore/* |
Disallow | /Sitecore |
Disallow | /Sitecore/* |
Disallow | /sitecore_files/ |
Disallow | /App_Browsers/ |
Disallow | /App_Config/ |
Disallow | /App_Data/ |
Disallow | /temp |
Disallow | /xsl/ |
Disallow | */api/popin/* |
Disallow | /api/productsearch/* |
Disallow | /api/popin/Video/* |
Disallow | /search* |
Other Records
Field | Value |
---|---|
sitemap | https://us.lorealprofessionnel.com/sitemap.xml |
Warnings
- 1 invalid line.