neutrogena.co.uk
robots.txt
Robots Exclusion Standard data for neutrogena.co.uk
Resource Scan
Scan Details
| Site Domain | neutrogena.co.uk |
| Base Domain | neutrogena.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-10-19T02:23:44+00:00 |
| Next Scan | 2024-11-18T02:23:44+00:00 |
Last Scan
| Scanned | 2024-10-19T02:23:44+00:00 |
| URL | https://neutrogena.co.uk/robots.txt |
| Redirect | https://www.neutrogena.co.uk/robots.txt |
| Redirect Domain | www.neutrogena.co.uk |
| Redirect Base | neutrogena.co.uk |
| Domain IPs | 23.32.29.8, 2406:3000:a::7c9b:de53, 2406:3000:a::7c9b:decb, 96.17.180.51 |
| Redirect IPs | 23.32.29.8, 2600:1413:1::1720:1d08, 2600:1413:1::6011:b433, 96.17.180.51 |
| Response IP | 184.50.85.156 |
| Found | Yes |
| Hash | ade1301763778a5a0c18dbccb6c7f014f1f81104f888564df52cf53d8090b6c2 |
| SimHash | 890844104513 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | /_next/ |
| Disallow | /*?bvstate |
| Disallow | /*?bvroute |
| Disallow | /where-to-buy/* |
| Disallow | /*.html |
| Disallow | /*.txt |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.neutrogena.co.uk/sitemap.xml |