avon.mx
robots.txt
Robots Exclusion Standard data for avon.mx
Resource Scan
Scan Details
Site Domain | avon.mx |
Base Domain | avon.mx |
Scan Status | Ok |
Last Scan | 2024-06-23T13:32:05+00:00 |
Next Scan | 2024-07-23T13:32:05+00:00 |
Last Scan
Scanned | 2024-06-23T13:32:05+00:00 |
URL | https://www.avon.mx/robots.txt |
Domain IPs | 23.52.171.217, 23.52.171.241 |
Response IP | 23.52.171.241 |
Found | Yes |
Hash | dfcc44ade230e1974e342a7680176bea112811c22690ec260bca513c77aa6aaf |
SimHash | 78075c24aa53 |
Groups
*
Rule | Path |
---|---|
Disallow | /undefined |
Disallow | /node/ |
Disallow | /en/ |
Disallow | /es/ |
Disallow | /m/ |
Disallow | /www/ |
Disallow | /consulta |
Disallow | /natura/ |
Disallow | /espaco/ |
Disallow | /nossas-marcas/* |
Disallow | /nossasmarcas/ |
Disallow | /admin/ |
Other Records
Field | Value |
---|---|
sitemap | https://avon.mx/sitemap.xml |