Log In Sign Up

volkswagen.pl
robots.txt

Robots Exclusion Standard data for volkswagen.pl

Resource Scan

Scan Details

Site Domain volkswagen.pl
Base Domain volkswagen.pl
Scan Status Ok
Last Scan2025-03-20T05:43:18+00:00
Next Scan 2025-04-19T05:43:18+00:00

Last Scan

Scanned2025-03-20T05:43:18+00:00
URL https://volkswagen.pl/robots.txt
Redirect https://www.volkswagen.pl:443/robots.txt
Redirect Domain www.volkswagen.pl
Redirect Base volkswagen.pl
Domain IPs 75.2.48.58
Redirect IPs 23.209.46.69, 23.209.46.79, 2600:1413:b000:1e::17d1:2e45, 2600:1413:b000:1e::17d1:2e4f
Response IP 23.45.207.172
Found Yes
Hash 94f488d234f6e2ff65b523d98e5b82b1dfeaa00b8ecbf36ea1ce7d5692bd8cf9
SimHash 6460f3d5c5b7

Groups

adsbot-google

Rule Path
Allow /app/

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*.notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.pl/pl.sitemap.xml
sitemap https://www.volkswagen.pl/idhub/content/dam/technical/sitemap/onehub-pl-showrooms-PC.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top