Log In Sign Up

volkswagen.co.jp
robots.txt

Robots Exclusion Standard data for volkswagen.co.jp

Resource Scan

Scan Details

Site Domain volkswagen.co.jp
Base Domain volkswagen.co.jp
Scan Status Ok
Last Scan2025-03-18T09:06:17+00:00
Next Scan 2025-04-17T09:06:17+00:00

Last Scan

Scanned2025-03-18T09:06:17+00:00
URL https://volkswagen.co.jp/robots.txt
Redirect https://www.volkswagen.co.jp:443/robots.txt
Redirect Domain www.volkswagen.co.jp
Redirect Base volkswagen.co.jp
Domain IPs 75.2.59.4
Redirect IPs 23.209.46.71, 23.209.46.94, 2600:1413:b000:13::b857:c19b, 2600:1413:b000:13::b857:c19f
Response IP 23.49.60.43
Found Yes
Hash 06c960e7164965e43fc9d721e0e4de0cb76428196ded6b3c043a73a41be7c2ce
SimHash 652092c5c7d7

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.volkswagen.co.jp/ja.sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top