Log In Sign Up

volkswagen-utilitaires.fr
robots.txt

Robots Exclusion Standard data for volkswagen-utilitaires.fr

Resource Scan

Scan Details

Site Domain volkswagen-utilitaires.fr
Base Domain volkswagen-utilitaires.fr
Scan Status Ok
Last Scan2025-02-22T13:16:59+00:00
Next Scan 2025-03-24T13:16:59+00:00

Last Scan

Scanned2025-02-22T13:16:59+00:00
URL https://volkswagen-utilitaires.fr/robots.txt
Redirect https://www.volkswagen-utilitaires.fr:443/robots.txt
Redirect Domain www.volkswagen-utilitaires.fr
Redirect Base volkswagen-utilitaires.fr
Domain IPs 75.2.48.58
Redirect IPs 23.209.46.12, 23.209.46.31, 2600:1413:b000:13::b857:c184, 2600:1413:b000:13::b857:c185
Response IP 42.99.140.193
Found Yes
Hash f3404fda03cfec179b06b66b186d38bd29d1967d26ffb0020d7dc32e49bcf292
SimHash 692093c5c7d5

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen-utilitaires.fr/fr.sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top