volkswagen-commercial-vehicles.be
robots.txt
Robots Exclusion Standard data for volkswagen-commercial-vehicles.be
Resource Scan
Scan Details
| Site Domain | volkswagen-commercial-vehicles.be |
| Base Domain | volkswagen-commercial-vehicles.be |
| Scan Status | Ok |
| Last Scan | 2025-03-23T13:13:22+00:00 |
| Next Scan | 2025-04-22T13:13:22+00:00 |
Last Scan
| Scanned | 2025-03-23T13:13:22+00:00 |
| URL | https://volkswagen-commercial-vehicles.be/robots.txt |
| Redirect | https://www.volkswagen-commercial-vehicles.be:443/robots.txt |
| Redirect Domain | www.volkswagen-commercial-vehicles.be |
| Redirect Base | volkswagen-commercial-vehicles.be |
| Domain IPs | 75.2.48.58 |
| Redirect IPs | 184.87.193.77, 184.87.193.89, 2600:1413:b000:13::b857:c18e, 2600:1413:b000:13::b857:c195 |
| Response IP | 23.209.46.81 |
| Found | Yes |
| Hash | 49c741339b9b5d198848bd9a142d9b1a7d303845732ea39bfdaad558d73f5875 |
| SimHash | 6d689245e593 |
Groups
googlebot
| Rule | Path |
|---|---|
| Allow | /app/ |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
slurp
| Rule | Path |
|---|---|
| Allow | /app/ |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
bingbot
| Rule | Path |
|---|---|
| Allow | /app/ |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
msnbot
| Rule | Path |
|---|---|
| Allow | /app/ |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
*
| Rule | Path |
|---|---|
| Disallow | /*.notification |
| Disallow | /*.integrator-includes.txt |
| Disallow | /*.integrator-includes.json |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.volkswagen-commercial-vehicles.be/idhub/content/dam/technical/sitemap/onehub-be-nl-temp-sitemap-CV.xml |
| sitemap | https://www.volkswagen-commercial-vehicles.be/idhub/content/dam/technical/sitemap/onehub-be-fr-temp-sitemap-CV.xml |
Comments