Log In Sign Up

volkswagen.lu
robots.txt

Robots Exclusion Standard data for volkswagen.lu

Resource Scan

Scan Details

Site Domain volkswagen.lu
Base Domain volkswagen.lu
Scan Status Ok
Last Scan2025-03-20T00:24:43+00:00
Next Scan 2025-04-19T00:24:43+00:00

Last Scan

Scanned2025-03-20T00:24:43+00:00
URL https://volkswagen.lu/robots.txt
Redirect https://www.volkswagen.lu:443/robots.txt
Redirect Domain www.volkswagen.lu
Redirect Base volkswagen.lu
Domain IPs 75.2.74.46
Redirect IPs 184.87.193.147, 184.87.193.155, 2600:1413:b000:13::b857:c193, 2600:1413:b000:13::b857:c19b
Response IP 23.52.171.137
Found Yes
Hash 4ea53f147bbd3939d187bd1c64a2b71e74e1b2a353bd7919fc05f3050db676f6
SimHash 656092c5c595

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.lu/fr.sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top