citroen.fr
robots.txt

Robots Exclusion Standard data for citroen.fr

Resource Scan

Scan Details

Site Domain citroen.fr
Base Domain citroen.fr
Scan Status Ok
Last Scan2024-05-27T21:42:04+00:00
Next Scan 2024-06-26T21:42:04+00:00

Last Scan

Scanned2024-05-27T21:42:04+00:00
URL https://citroen.fr/robots.txt
Redirect https://www.citroen.fr/robots.txt
Redirect Domain www.citroen.fr
Redirect Base citroen.fr
Domain IPs 217.70.184.55
Redirect IPs 23.52.171.209, 23.59.168.171, 2600:1413:b000:1b::17d7:705, 2600:1413:b000:1b::17d7:71b
Response IP 23.52.171.209
Found Yes
Hash cb9f840102a0dada7127a2ae976256e1720ad94dc7e9af60a9106ccecb2f79a3
SimHash 69190c1cfe1b

Groups

*

Rule Path
Disallow */masterhead-video*
Disallow /api/
Disallow /*?id
Disallow /*utm_content
Disallow /*utm_campaign
Disallow /*utm_medium
Disallow /*?lcdv
Disallow /*?gclsrc
Disallow /*?&gclid
Disallow /*utm_source

Other Records

Field Value
sitemap https://www.citroen.fr/sitemap.xml

Warnings

  • 3 invalid lines.