Log In Sign Up

volkswagen.se
robots.txt

Robots Exclusion Standard data for volkswagen.se

Resource Scan

Scan Details

Site Domain volkswagen.se
Base Domain volkswagen.se
Scan Status Ok
Last Scan2025-03-25T17:53:48+00:00
Next Scan 2025-04-24T17:53:48+00:00

Last Scan

Scanned2025-03-25T17:53:48+00:00
URL https://volkswagen.se/robots.txt
Redirect https://www.volkswagen.se:443/robots.txt
Redirect Domain www.volkswagen.se
Redirect Base volkswagen.se
Domain IPs 75.2.74.46
Redirect IPs 23.209.46.74, 23.209.46.83, 2600:1413:b000:13::b857:c18e, 2600:1413:b000:13::b857:c19b
Response IP 23.45.207.174
Found Yes
Hash e4290545c85d596230d350555f4f83d7adea08676acf4225428ff0bc0214d088
SimHash 696093d5c5b5

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /test/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.se/sv.sitemap.xml
sitemap http://volkswagen.se/idhub/content/dam/technical/sitemap/onehub-se-showrooms-pc.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top