volkswagen-vans.co.uk
robots.txt

Robots Exclusion Standard data for volkswagen-vans.co.uk

Resource Scan

Scan Details

Site Domain volkswagen-vans.co.uk
Base Domain volkswagen-vans.co.uk
Scan Status Ok
Last Scan2025-02-27T00:40:37+00:00
Next Scan 2025-03-29T00:40:37+00:00

Last Scan

Scanned2025-02-27T00:40:37+00:00
URL https://volkswagen-vans.co.uk/robots.txt
Redirect https://www.volkswagen-vans.co.uk:443/robots.txt
Redirect Domain www.volkswagen-vans.co.uk
Redirect Base volkswagen-vans.co.uk
Domain IPs 75.2.74.46
Redirect IPs 23.46.230.132, 23.46.230.157, 2600:1413:b000:13::b857:c184, 2600:1413:b000:13::b857:c195
Response IP 23.52.171.122
Found Yes
Hash 78f094b43d793ad4353ca433c59c805da2940d22f61e4df094d3de964b390dfc
SimHash 2149de574c80

Groups

*

Rule Path
Disallow /*.notification_5f79b28a9555e9b0e5c2be7d55af573a.html$
Disallow /*?page=*
Disallow /content/vw_nfz/importers/
Disallow /*?dealerid=*
Disallow /?dealerId=
Disallow /app/dccsearch/
Disallow /app/dccforms/vwn-gb/testdrive/
Disallow /app/dccforms/vwn-gb/quote/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Allow /content/vw_nfz/magazine/gb/
Disallow /*?secondaryTenant-app=true

Other Records

Field Value
sitemap https://www.volkswagen-vans.co.uk/en.sitemap.xml

Comments

  • ROBOTS TXT UK CV
  • sitemap