loreal.com
robots.txt
Robots Exclusion Standard data for loreal.com
Resource Scan
Scan Details
Site Domain | loreal.com |
Base Domain | loreal.com |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-09T18:49:45+00:00 |
Next Scan | 2024-09-07T18:49:45+00:00 |
Last Successful Scan
Scanned | 2023-03-24T00:38:43+00:00 |
URL | https://loreal.com/robots.txt |
Redirect | https://www.loreal.com/robots.txt |
Redirect Domain | www.loreal.com |
Redirect Base | loreal.com |
Domain IPs | 104.16.212.90, 104.16.213.90, 2606:4700::6810:d45a, 2606:4700::6810:d55a |
Redirect IPs | 104.16.212.90, 104.16.213.90, 2606:4700::6810:d45a, 2606:4700::6810:d55a |
Response IP | 104.16.213.90 |
Found | Yes |
Hash | 41e3e9056bd77be8962bd68de7a056409c99fddc951877a3fb0b2cc253d4f99a |
SimHash | ac0148504553 |
Groups
*
Rule | Path |
---|---|
Disallow | *.ashx |
Disallow | */search |
Disallow | *%26sortBy |
Disallow | *?sortBy |
Disallow | *default.aspx |
Disallow | *Default.aspx |
Other Records
Field | Value |
---|---|
sitemap | https://www.loreal.com/sitemap.xml |