Log In Sign Up

volkswagen.com.br
robots.txt

Robots Exclusion Standard data for volkswagen.com.br

Resource Scan

Scan Details

Site Domain volkswagen.com.br
Base Domain volkswagen.com.br
Scan Status Ok
Last Scan2025-03-23T14:40:23+00:00
Next Scan 2025-04-22T14:40:23+00:00

Last Scan

Scanned2025-03-23T14:40:23+00:00
URL https://volkswagen.com.br/robots.txt
Redirect https://www.vw.com.br:443/robots.txt
Redirect Domain www.vw.com.br
Redirect Base vw.com.br
Domain IPs 75.2.69.18
Redirect IPs 23.209.46.73, 23.209.46.75, 2600:1413:b000:13::b857:c189, 2600:1413:b000:13::b857:c195
Response IP 42.99.140.203
Found Yes
Hash facf6d518841989abf20ba5c845ee982055eef33fd7895c32e6e454ff1602bbf
SimHash 6d6092c5c795

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.vw.com.br/pt.sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top