Log In Sign Up

vwcomerciales.com.mx
robots.txt

Robots Exclusion Standard data for vwcomerciales.com.mx

Resource Scan

Scan Details

Site Domain vwcomerciales.com.mx
Base Domain vwcomerciales.com.mx
Scan Status Ok
Last Scan2024-05-08T14:18:18+00:00
Next Scan 2024-06-07T14:18:18+00:00

Last Scan

Scanned2024-05-08T14:18:18+00:00
URL https://vwcomerciales.com.mx/robots.txt
Redirect https://www.vwcomerciales.com.mx:443/robots.txt
Redirect Domain www.vwcomerciales.com.mx
Redirect Base vwcomerciales.com.mx
Domain IPs 75.2.18.28
Redirect IPs 18.155.99.34, 18.155.99.37, 18.155.99.72, 18.155.99.78, 2600:9000:229f:3600:8:e32f:4100:93a1, 2600:9000:229f:4200:8:e32f:4100:93a1, 2600:9000:229f:8c00:8:e32f:4100:93a1, 2600:9000:229f:9200:8:e32f:4100:93a1, 2600:9000:229f:9a00:8:e32f:4100:93a1, 2600:9000:229f:9c00:8:e32f:4100:93a1, 2600:9000:229f:a00:8:e32f:4100:93a1, 2600:9000:229f:c400:8:e32f:4100:93a1
Response IP 13.33.30.83
Found Yes
Hash 2b1051c61c9ca5cce43128a73b379795ac7c9adbd088aa14195faf120bf78a0d
SimHash 65689bc4c5b1

Groups

googlebot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Disallow /*includes.txt

slurp

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

bingbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

msnbot

Rule Path
Allow /app/
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json

*

Rule Path
Disallow /app/
Disallow /*notification
Disallow /*.integrator-includes.txt
Disallow /*.integrator-includes.json
Back to top

Other Records

Field Value
sitemap https://www.vwcomerciales.com.mx/es.sitemap.xml
Back to top

Comments

  • ROBOTS TXT VWN MX ## whitelist user agents / pages to visit for app-paths
  • default block
  • SITEMAP
Back to top