Log In Sign Up

vwcanarias.com
robots.txt

Robots Exclusion Standard data for vwcanarias.com

Resource Scan

Scan Details

Site Domain vwcanarias.com
Base Domain vwcanarias.com
Scan Status Ok
Last Scan2025-03-23T13:36:22+00:00
Next Scan 2025-04-22T13:36:22+00:00

Last Scan

Scanned2025-03-23T13:36:22+00:00
URL https://vwcanarias.com/robots.txt
Redirect https://www.vwcanarias.com:443/robots.txt
Redirect Domain www.vwcanarias.com
Redirect Base vwcanarias.com
Domain IPs 75.2.74.46
Redirect IPs 23.209.46.74, 23.209.46.97, 2600:1413:b000:13::b857:c193, 2600:1413:b000:13::b857:c195, 2600:1413:b000:13::b857:c19c, 2600:1413:b000:13::b857:c19e, 2600:1413:b000:13::b857:c19f
Response IP 42.99.140.176
Found Yes
Hash cf8d39b7b4941b954e68ab32e977d9e17af498f6f86c58be9e859fa24b977658
SimHash 652092c5c7b7

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.vwcanarias.com/es.sitemap.xml
Back to top

Comments

  • whitelist user agents / pages to visit for app-paths
  • default block
  • sitemap
Back to top