Log In Sign Up

volkswagen-me.com
robots.txt

Robots Exclusion Standard data for volkswagen-me.com

Resource Scan

Scan Details

Site Domain volkswagen-me.com
Base Domain volkswagen-me.com
Scan Status Ok
Last Scan2024-09-14T10:03:22+00:00
Next Scan 2024-10-14T10:03:22+00:00

Last Scan

Scanned2024-09-14T10:03:22+00:00
URL https://www.volkswagen-me.com/robots.txt
Domain IPs 13.33.30.20, 13.33.30.37, 13.33.30.42, 13.33.30.78, 2600:9000:229f:3600:8:926c:8980:93a1, 2600:9000:229f:4400:8:926c:8980:93a1, 2600:9000:229f:5e00:8:926c:8980:93a1, 2600:9000:229f:9e00:8:926c:8980:93a1, 2600:9000:229f:a00:8:926c:8980:93a1, 2600:9000:229f:ae00:8:926c:8980:93a1, 2600:9000:229f:cc00:8:926c:8980:93a1, 2600:9000:229f:d400:8:926c:8980:93a1
Response IP 13.33.30.78
Found Yes
Hash 0e5210d86ef621eb8caabb2b657d68ec9533d11fb8898721540e5f69fe0d6616
SimHash 692893c5c7d7

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Allow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen-me.com/en.sitemap.xml
sitemap https://www.volkswagen-me.com/ar.sitemap.xml
Back to top

Comments

  • ROBOTS TXT
  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top