citroen.no
robots.txt

Robots Exclusion Standard data for citroen.no

Resource Scan

Scan Details

Site Domain citroen.no
Base Domain citroen.no
Scan Status Ok
Last Scan2024-09-12T04:11:12+00:00
Next Scan 2024-10-12T04:11:12+00:00

Last Scan

Scanned2024-09-12T04:11:12+00:00
URL https://citroen.no/robots.txt
Redirect https://www.citroen.no/robots.txt
Redirect Domain www.citroen.no
Redirect Base citroen.no
Domain IPs 217.70.184.55
Redirect IPs 23.215.7.21, 23.215.7.4, 2600:1413:b000:1b::17d7:704, 2600:1413:b000:1b::17d7:715
Response IP 96.17.180.43
Found Yes
Hash ffbb8977b5c4166e78a740b403ae11befb605ef63b79b27de3fb900158ff60dc
SimHash 6918280cfe1b

Groups

*

Rule Path
Disallow */masterhead-video*
Disallow /api/
Disallow /*?id
Disallow /*utm_content
Disallow /*utm_campaign
Disallow /*utm_medium
Disallow /*?lcdv
Disallow /*?gclsrc
Disallow /*?&gclid
Disallow /*utm_source

Other Records

Field Value
sitemap https://www.citroen.no/sitemap.xml

Warnings

  • 3 invalid lines.