Log In Sign Up

volkswagen.co.in
robots.txt

Robots Exclusion Standard data for volkswagen.co.in

Resource Scan

Scan Details

Site Domain volkswagen.co.in
Base Domain volkswagen.co.in
Scan Status Ok
Last Scan2025-04-17T12:41:05+00:00
Next Scan 2025-05-17T12:41:05+00:00

Last Scan

Scanned2025-04-17T12:41:05+00:00
URL https://volkswagen.co.in/robots.txt
Redirect https://www.volkswagen.co.in:443/robots.txt
Redirect Domain www.volkswagen.co.in
Redirect Base volkswagen.co.in
Domain IPs 2a01:4dc0:0:4f00::c272:200c, 75.2.59.4
Redirect IPs 23.46.230.136, 23.46.230.137, 2600:1413:5000:25::1738:6109, 2600:1413:5000:25::1738:6136
Response IP 23.54.155.74
Found Yes
Hash 1fc7e250b35025e60ad9fcfbe8c7e26d223cbd0ed6068e025de8479014060d2e
SimHash 696093c5c7b7

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.co.in/en.sitemap.xml
sitemap https://www.volkswagen.co.in/idhub/content/dam/technical/sitemap/onehub-india-local-apps-sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top