Log In Sign Up

vw.pl
robots.txt

Robots Exclusion Standard data for vw.pl

Resource Scan

Scan Details

Site Domain vw.pl
Base Domain vw.pl
Scan Status Ok
Last Scan5/18/2025, 8:30:30 PM
Next Scan 6/17/2025, 8:30:30 PM

Last Scan

Scanned5/18/2025, 8:30:30 PM
URL http://vw.pl/robots.txt
Redirect https://www.volkswagen.pl:443/robots.txt
Redirect Domain www.volkswagen.pl
Redirect Base volkswagen.pl
Domain IPs 75.2.48.58
Redirect IPs 23.54.155.69, 23.54.155.73, 2600:1413:b000:1e::17d1:2e4f, 2600:1413:b000:1e::17d1:2e55
Response IP 23.54.118.108
Found Yes
Hash 94f488d234f6e2ff65b523d98e5b82b1dfeaa00b8ecbf36ea1ce7d5692bd8cf9
SimHash 6460f3d5c5b7

Groups

adsbot-google

Rule Path
Allow /app/

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*.notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.pl/pl.sitemap.xml
sitemap https://www.volkswagen.pl/idhub/content/dam/technical/sitemap/onehub-pl-showrooms-PC.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top