Log In Sign Up

volkswagen.fr
robots.txt

Robots Exclusion Standard data for volkswagen.fr

Resource Scan

Scan Details

Site Domain volkswagen.fr
Base Domain volkswagen.fr
Scan Status Ok
Last Scan2025-03-19T04:36:45+00:00
Next Scan 2025-04-18T04:36:45+00:00

Last Scan

Scanned2025-03-19T04:36:45+00:00
URL https://volkswagen.fr/robots.txt
Redirect https://www.volkswagen.fr:443/robots.txt
Redirect Domain www.volkswagen.fr
Redirect Base volkswagen.fr
Domain IPs 75.2.48.58
Redirect IPs 23.46.230.136, 23.46.230.149, 2600:1413:b000:13::b857:c18d, 2600:1413:b000:13::b857:c19f
Response IP 42.99.140.193
Found Yes
Hash 6ab6863aa3261a4fe0ea59b1976b8c38b99ed740c9eef45619a30f834b2b3137
SimHash 652093d5c5b5

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.fr/idhub/content/dam/technical/sitemap/onehub-fr-manual-pc.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top