volkswagen.fi
robots.txt

Robots Exclusion Standard data for volkswagen.fi

Resource Scan

Scan Details

Site Domain volkswagen.fi
Base Domain volkswagen.fi
Scan Status Ok
Last Scan5/27/2025, 6:38:35 PM
Next Scan 6/26/2025, 6:38:35 PM

Last Scan

Scanned5/27/2025, 6:38:35 PM
URL https://volkswagen.fi/robots.txt
Redirect https://www.volkswagen.fi:443/robots.txt
Redirect Domain www.volkswagen.fi
Redirect Base volkswagen.fi
Domain IPs 75.2.48.58
Redirect IPs 125.56.219.24, 2600:1413:1::1734:ab90, 2600:1413:1::1734:ab99, 96.17.72.16
Response IP 23.61.202.38
Found Yes
Hash 15d443850802a5e280fb146e5e012987320265ebb5ccefbfdc810a08bcffef5d
SimHash 6d6093c5c5d7

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

Other Records

Field Value
sitemap https://www.volkswagen.fi/fi.sitemap.xml

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap