Log In Sign Up

volkswagen.uz
robots.txt

Robots Exclusion Standard data for volkswagen.uz

Resource Scan

Scan Details

Site Domain volkswagen.uz
Base Domain volkswagen.uz
Scan Status Ok
Last Scan2024-11-13T12:10:48+00:00
Next Scan 2024-12-13T12:10:48+00:00

Last Scan

Scanned2024-11-13T12:10:48+00:00
URL https://www.volkswagen.uz/robots.txt
Domain IPs 108.156.133.13, 108.156.133.4, 108.156.133.40, 108.156.133.68, 2600:9000:2755:1800:a:a87b:72c0:93a1, 2600:9000:2755:2e00:a:a87b:72c0:93a1, 2600:9000:2755:3600:a:a87b:72c0:93a1, 2600:9000:2755:400:a:a87b:72c0:93a1, 2600:9000:2755:6e00:a:a87b:72c0:93a1, 2600:9000:2755:7c00:a:a87b:72c0:93a1, 2600:9000:2755:b400:a:a87b:72c0:93a1, 2600:9000:2755:e00:a:a87b:72c0:93a1
Response IP 108.156.133.40
Found Yes
Hash 8e7422453a59d60d56226b162e08c3c994fca78e6212572fe1556f6dc1511ab8
SimHash 686a9ac4c7b7

Groups

googlebot

Rule Path
Allow /app/
Disallow /app/tbo/*
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

gsa-crawler

Rule Path
Allow /app/

gsa-crawler

Rule Path
Allow /elektromobilitaet/

*

Rule Path
Allow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.uz/ru.sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top