citroen.fr
robots.txt
Robots Exclusion Standard data for citroen.fr
Resource Scan
Scan Details
| Site Domain | citroen.fr |
| Base Domain | citroen.fr |
| Scan Status | Ok |
| Last Scan | 2024-10-24T21:49:37+00:00 |
| Next Scan | 2024-11-23T21:49:37+00:00 |
Last Scan
| Scanned | 2024-10-24T21:49:37+00:00 |
| URL | https://www.citroen.fr/robots.txt |
| Domain IPs | 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:71b, 96.17.180.17, 96.17.180.3 |
| Response IP | 96.17.180.49 |
| Found | Yes |
| Hash | cb9f840102a0dada7127a2ae976256e1720ad94dc7e9af60a9106ccecb2f79a3 |
| SimHash | 69190c1cfe1b |
Groups
*
| Rule | Path |
|---|---|
| Disallow | */masterhead-video* |
| Disallow | /api/ |
| Disallow | /*?id |
| Disallow | /*utm_content |
| Disallow | /*utm_campaign |
| Disallow | /*utm_medium |
| Disallow | /*?lcdv |
| Disallow | /*?gclsrc |
| Disallow | /*?&gclid |
| Disallow | /*utm_source |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.citroen.fr/sitemap.xml |
Warnings
- 3 invalid lines.