Log In Sign Up

volkswagen-commercial.com.tw
robots.txt

Robots Exclusion Standard data for volkswagen-commercial.com.tw

Resource Scan

Scan Details

Site Domain volkswagen-commercial.com.tw
Base Domain volkswagen-commercial.com.tw
Scan Status Ok
Last Scan2024-09-24T16:22:14+00:00
Next Scan 2024-10-24T16:22:14+00:00

Last Scan

Scanned2024-09-24T16:22:14+00:00
URL https://volkswagen-commercial.com.tw/robots.txt
Redirect https://www.volkswagen-commercial.com.tw:443/robots.txt
Redirect Domain www.volkswagen-commercial.com.tw
Redirect Base volkswagen-commercial.com.tw
Domain IPs 2a01:4dc0:0:4f00::c272:200c, 75.2.59.4
Redirect IPs 18.155.68.110, 18.155.68.65, 18.155.68.80, 18.155.68.96, 2600:9000:23d2:5e00:0:b8ca:f340:93a1, 2600:9000:23d2:8a00:0:b8ca:f340:93a1, 2600:9000:23d2:b600:0:b8ca:f340:93a1, 2600:9000:23d2:c200:0:b8ca:f340:93a1, 2600:9000:23d2:da00:0:b8ca:f340:93a1, 2600:9000:23d2:e200:0:b8ca:f340:93a1, 2600:9000:23d2:f000:0:b8ca:f340:93a1, 2600:9000:23d2:fe00:0:b8ca:f340:93a1
Response IP 18.155.68.80
Found Yes
Hash 101514c7414e3b3b9f655d07821bc709095c29da9c79bfeb0b439cc0e3132f2a
SimHash 6d6093c5c7b5

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen-commercial.com.tw/zh.sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top