volkswagen.es
robots.txt
Robots Exclusion Standard data for volkswagen.es
Resource Scan
Scan Details
Site Domain | volkswagen.es |
Base Domain | volkswagen.es |
Scan Status | Ok |
Last Scan | 2024-10-07T08:38:30+00:00 |
Next Scan | 2024-10-21T08:38:30+00:00 |
Last Scan
Scanned | 2024-10-07T08:38:30+00:00 |
URL | https://volkswagen.es/robots.txt |
Redirect | https://www.volkswagen.es:443/robots.txt |
Redirect Domain | www.volkswagen.es |
Redirect Base | volkswagen.es |
Domain IPs | 75.2.48.58 |
Redirect IPs | 192.229.179.206 |
Response IP | 192.229.179.206 |
Found | Yes |
Hash | ac93dd3657e21a282eb401191811403c1d4d052eed23e3a87317f963ae21742d |
SimHash | 682092f7e5e1 |
Groups
googlebot
Rule | Path |
---|---|
Allow | /app/ |
Disallow | /*.integrator-includes.txt |
Disallow | /*.integrator-includes.json |
slurp
Rule | Path |
---|---|
Allow | /app/ |
Disallow | /*.integrator-includes.txt |
Disallow | /*.integrator-includes.json |
bingbot
Rule | Path |
---|---|
Allow | /app/ |
Disallow | /*.integrator-includes.txt |
Disallow | /*.integrator-includes.json |
msnbot
Rule | Path |
---|---|
Allow | /app/ |
Disallow | /*.integrator-includes.txt |
Disallow | /*.integrator-includes.json |
*
Rule | Path |
---|---|
Disallow | /app/ |
Disallow | /*.notification |
Disallow | /*.integrator-includes.txt |
Disallow | /*.integrator-includes.json |
Disallow | /es/dev/ |
Disallow | /es/backup/ |
Disallow | /es/test/ |
Disallow | /ads/ |
Disallow | /vwcms_publish/ |
Disallow | /es/formularios/ |
Disallow | /content/vw_pkw/ |
Disallow | /es/mundo_vw/ |
Disallow | /*debugClientLibs%3D |
Disallow | /*page%3Dengine |
Disallow | /*page%3Dcompare |
Disallow | /*page%3Dwheels |
Disallow | /*leadType%3Dcontact |
Disallow | /*iframe%3Dtrue |
Disallow | /*configProvider.json |
Disallow | /*cdnCacheId |
Disallow | /*ordenacion%3D |
Disallow | /*condicion |
Disallow | /stock/*/oferta |
Disallow | /stock/*/solicitud-bloqueo |
Disallow | /stock/*condicion |
Disallow | /stock/*pagina |
Other Records
Field | Value |
---|---|
sitemap | https://www.volkswagen.es/es.sitemap.xml |
Comments