Log In Sign Up

volkswagen.ee
robots.txt

Robots Exclusion Standard data for volkswagen.ee

Resource Scan

Scan Details

Site Domain volkswagen.ee
Base Domain volkswagen.ee
Scan Status Ok
Last Scan2025-03-03T15:16:50+00:00
Next Scan 2025-04-02T15:16:50+00:00

Last Scan

Scanned2025-03-03T15:16:50+00:00
URL https://volkswagen.ee/robots.txt
Redirect https://www.volkswagen.ee:443/robots.txt
Redirect Domain www.volkswagen.ee
Redirect Base volkswagen.ee
Domain IPs 2a01:4dc0:0:4f00::c272:200c, 75.2.74.46
Redirect IPs 23.45.207.205, 23.45.207.210, 2600:1413:b000:1e::17d1:2e4a, 2600:1413:b000:1e::17d1:2e4f
Response IP 23.45.207.169
Found Yes
Hash 42902955bd2d0c0c9aaabad2d2274eec479e6faf53410777df5c74d63064756d
SimHash 6c2092c5c7f7

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.ee/et.sitemap.xml
sitemap https://www.volkswagen.ee/idhub/content/dam/technical/sitemap/onehub-ee-showrooms.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top