volkswagen-nutzfahrzeuge.ch
robots.txt

Robots Exclusion Standard data for volkswagen-nutzfahrzeuge.ch

Resource Scan

Scan Details

Site Domain volkswagen-nutzfahrzeuge.ch
Base Domain volkswagen-nutzfahrzeuge.ch
Scan Status Ok
Last Scan2025-03-22T04:12:57+00:00
Next Scan 2025-04-21T04:12:57+00:00

Last Scan

Scanned2025-03-22T04:12:57+00:00
URL https://volkswagen-nutzfahrzeuge.ch/robots.txt
Redirect https://www.volkswagen-nutzfahrzeuge.ch:443/robots.txt
Redirect Domain www.volkswagen-nutzfahrzeuge.ch
Redirect Base volkswagen-nutzfahrzeuge.ch
Domain IPs 75.2.74.46
Redirect IPs 184.87.193.74, 184.87.193.77, 2600:1413:b000:13::b857:c186, 2600:1413:b000:13::b857:c196
Response IP 23.45.207.177
Found Yes
Hash aaf5def076ee921bf18260a25ea668ed55a97cfa8b80347c762fdf6cc39f052d
SimHash 4d6892d5c7d5

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

Other Records

Field Value
sitemap https://www.volkswagen-nutzfahrzeuge.ch/de.sitemap.xml
sitemap https://www.volkswagen-nutzfahrzeuge.ch/fr.sitemap.xml
sitemap https://www.volkswagen-nutzfahrzeuge.ch/it.sitemap.xml

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap