Log In Sign Up

vw.ca
robots.txt

Robots Exclusion Standard data for vw.ca

Resource Scan

Scan Details

Site Domain vw.ca
Base Domain vw.ca
Scan Status Ok
Last Scan2025-03-23T22:41:26+00:00
Next Scan 2025-04-22T22:41:26+00:00

Last Scan

Scanned2025-03-23T22:41:26+00:00
URL https://vw.ca/robots.txt
Redirect https://www.vw.ca:443/robots.txt
Redirect Domain www.vw.ca
Redirect Base vw.ca
Domain IPs 75.2.18.28
Redirect IPs 125.56.219.10, 2600:1413:b000:13::b857:c195, 2600:1413:b000:13::b857:c19b, 96.17.72.17
Response IP 23.52.171.146
Found Yes
Hash c84a79d8770e2844f7a83364e252672fa68591a1d8250c9f6865789688c57670
SimHash 69209ac5c5d5

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.vw.ca/en.sitemap.xml
sitemap https://www.vw.ca/fr.sitemap.xml
Back to top

Comments

  • ROBOTS TXT
  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top