vw.com.br
robots.txt

Robots Exclusion Standard data for vw.com.br

Resource Scan

Scan Details

Site Domain vw.com.br
Base Domain vw.com.br
Scan Status Ok
Last Scan3/25/2025, 4:23:53 AM
Next Scan 4/24/2025, 4:23:53 AM

Last Scan

Scanned3/25/2025, 4:23:53 AM
URL https://www.vw.com.br/robots.txt
Domain IPs 184.87.193.137, 184.87.193.148, 2600:1413:1::48f7:7fe3, 2600:1413:1::48f7:7ffb
Response IP 173.222.148.35
Found Yes
Hash facf6d518841989abf20ba5c845ee982055eef33fd7895c32e6e454ff1602bbf
SimHash 6d6092c5c795

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

Other Records

Field Value
sitemap https://www.vw.com.br/pt.sitemap.xml

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap