citroen.co.uk
robots.txt
Robots Exclusion Standard data for citroen.co.uk
Resource Scan
Scan Details
| Site Domain | citroen.co.uk |
| Base Domain | citroen.co.uk |
| Scan Status | Ok |
| Last Scan | 2024-09-26T21:00:26+00:00 |
| Next Scan | 2024-10-26T21:00:26+00:00 |
Last Scan
| Scanned | 2024-09-26T21:00:26+00:00 |
| URL | https://citroen.co.uk/robots.txt |
| Redirect | https://www.citroen.co.uk/robots.txt |
| Redirect Domain | www.citroen.co.uk |
| Redirect Base | citroen.co.uk |
| Domain IPs | 217.70.184.55 |
| Redirect IPs | 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:71b, 96.17.180.17, 96.17.180.3 |
| Response IP | 96.17.180.49 |
| Found | Yes |
| Hash | 51487bd44876045ac281469025c2c6e7066e8fc2ce2a7af27852f6b7c962b2f8 |
| SimHash | 6b4941446f17 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /*? |
| Disallow | /tools/legal-information.html |
| Disallow | /tools/privacy-policy.html |
| Disallow | /tools/cookies-policy.html |
| Disallow | /tools/404-error.html |
| Disallow | */navigation-partials/* |
| Disallow | */video-modal* |
| Disallow | */modal-video* |
| Disallow | */masterhead-video* |
| Allow | /content/dam* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.citroen.co.uk/sitemap.xml |