aveeno.co.uk
robots.txt
Robots Exclusion Standard data for aveeno.co.uk
Resource Scan
Scan Details
Site Domain | aveeno.co.uk |
Base Domain | aveeno.co.uk |
Scan Status | Ok |
Last Scan | 2024-11-11T21:02:02+00:00 |
Next Scan | 2024-11-18T21:02:02+00:00 |
Last Scan
Scanned | 2024-11-11T21:02:02+00:00 |
URL | https://www.aveeno.co.uk/robots.txt |
Domain IPs | 23.32.29.17, 2600:1413:b000:1b::17d7:71d, 2600:1413:b000:1b::17d7:71f, 96.17.180.46 |
Response IP | 96.17.180.46 |
Found | Yes |
Hash | c0b907d50bf353b2e833320afdfee5c27894005524b2e8da4ae595925a95349d |
SimHash | 8b10d8124513 |
Groups
*
Rule | Path |
---|---|
Allow | / |
Disallow | /*?bvstate |
Disallow | /*?bvroute |
Disallow | /where-to-buy/* |
Other Records
Field | Value |
---|---|
sitemap | https://www.aveeno.co.uk/sitemap.xml |