Log In Sign Up

volkswagen.lt
robots.txt

Robots Exclusion Standard data for volkswagen.lt

Resource Scan

Scan Details

Site Domain volkswagen.lt
Base Domain volkswagen.lt
Scan Status Ok
Last Scan3/21/2025, 5:22:34 AM
Next Scan 4/20/2025, 5:22:34 AM

Last Scan

Scanned3/21/2025, 5:22:34 AM
URL https://volkswagen.lt/robots.txt
Redirect https://www.volkswagen.lt:443/robots.txt
Redirect Domain www.volkswagen.lt
Redirect Base volkswagen.lt
Domain IPs 2a01:4dc0:0:4f00::c272:200c, 75.2.74.46
Redirect IPs 23.46.230.145, 23.46.230.150, 2600:1413:b000:1e::17d1:2e4a, 2600:1413:b000:1e::17d1:2e53, 2600:1413:b000:1e::17d1:2e54, 2600:1413:b000:1e::17d1:2e59, 2600:1413:b000:1e::17d1:2e5f
Response IP 23.45.207.172
Found Yes
Hash 347c27ecd4257b7cbac5939415b664331a292377c0d7d551497a6f11cc12e330
SimHash 60209ac5e7b5

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.lt/lt.sitemap.xml
sitemap https://www.volkswagen.lt/idhub/content/dam/technical/sitemap/onehub-lt-showrooms.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top