citroen.co.nz
robots.txt
Robots Exclusion Standard data for citroen.co.nz
Resource Scan
Scan Details
| Site Domain | citroen.co.nz |
| Base Domain | citroen.co.nz |
| Scan Status | Ok |
| Last Scan | 2024-06-16T15:57:27+00:00 |
| Next Scan | 2024-07-16T15:57:27+00:00 |
Last Scan
| Scanned | 2024-06-16T15:57:27+00:00 |
| URL | https://citroen.co.nz/robots.txt |
| Redirect | https://www.citroen.co.nz/robots.txt |
| Redirect Domain | www.citroen.co.nz |
| Redirect Base | citroen.co.nz |
| Domain IPs | 217.70.184.55 |
| Redirect IPs | 23.52.40.50, 23.52.40.59, 2600:1413:a000::172c:420, 2600:1413:a000::172c:458 |
| Response IP | 96.17.180.43 |
| Found | Yes |
| Hash | 5a06fc9569f09d4bf9aa24694e60a346460d9a45fd4a07b8ffcfabf8ac31ac8f |
| SimHash | 69182c1cfe1b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */masterhead-video* |
| Disallow | /api/ |
| Disallow | /*?id |
| Disallow | /*utm_content |
| Disallow | /*utm_campaign |
| Disallow | /*utm_medium |
| Disallow | /*?lcdv |
| Disallow | /*?gclsrc |
| Disallow | /*?&gclid |
| Disallow | /*utm_source |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.citroen.co.nz/sitemap.xml |
Warnings
- 3 invalid lines.