Log In Sign Up

volkswagen.com.tw
robots.txt

Robots Exclusion Standard data for volkswagen.com.tw

Resource Scan

Scan Details

Site Domain volkswagen.com.tw
Base Domain volkswagen.com.tw
Scan Status Ok
Last Scan2024-09-26T10:48:55+00:00
Next Scan 2024-10-26T10:48:55+00:00

Last Scan

Scanned2024-09-26T10:48:55+00:00
URL https://volkswagen.com.tw/robots.txt
Redirect https://www.volkswagen.com.tw:443/robots.txt
Redirect Domain www.volkswagen.com.tw
Redirect Base volkswagen.com.tw
Domain IPs 2a01:4dc0:0:4f00::c272:200c, 75.2.59.4
Redirect IPs 108.157.254.126, 108.157.254.13, 108.157.254.25, 108.157.254.99, 2600:9000:2753:1e00:c:58c2:2480:93a1, 2600:9000:2753:3a00:c:58c2:2480:93a1, 2600:9000:2753:4a00:c:58c2:2480:93a1, 2600:9000:2753:4c00:c:58c2:2480:93a1, 2600:9000:2753:9000:c:58c2:2480:93a1, 2600:9000:2753:ba00:c:58c2:2480:93a1, 2600:9000:2753:d800:c:58c2:2480:93a1, 2600:9000:2753:e800:c:58c2:2480:93a1
Response IP 108.157.254.99
Found Yes
Hash b437e9dc3f077c20a29cb7548c8f45e7b6e451a6a6bbcfab48645c196afb95e0
SimHash 616093c5c7d7

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.com.tw/zh.sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top