volkswagen.de
robots.txt
Robots Exclusion Standard data for volkswagen.de
Resource Scan
Scan Details
| Site Domain | volkswagen.de |
| Base Domain | volkswagen.de |
| Scan Status | Ok |
| Last Scan | 2024-11-04T22:06:56+00:00 |
| Next Scan | 2024-11-18T22:06:56+00:00 |
Last Scan
| Scanned | 2024-11-04T22:06:56+00:00 |
| URL | https://volkswagen.de/robots.txt |
| Redirect | https://www.volkswagen.de:443/robots.txt |
| Redirect Domain | www.volkswagen.de |
| Redirect Base | volkswagen.de |
| Domain IPs | 75.2.48.58 |
| Redirect IPs | 192.229.179.237 |
| Response IP | 192.229.179.237 |
| Found | Yes |
| Hash | 642f7bff9ef09b9523f50a5682fd48d63972aa8a1d05f171f541e5b2ceea986c |
| SimHash | 69709ac4e797 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | /app/ |
| Disallow | /app/tbo/* |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
slurp
| Rule | Path |
|---|---|
| Allow | /app/ |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
bingbot
| Rule | Path |
|---|---|
| Allow | /app/ |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
msnbot
| Rule | Path |
|---|---|
| Allow | /app/ |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
*
| Rule | Path |
|---|---|
| Allow | /app/ |
| Disallow | /*notification |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
| Disallow | /de/modelle/verfuegbare-fahrzeuge-suche.html/__app/search/car/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.volkswagen.de/de.sitemap.xml |
Comments