burton.cl
robots.txt

Robots Exclusion Standard data for burton.cl

Resource Scan

Scan Details

Site Domain burton.cl
Base Domain burton.cl
Scan Status Ok
Last Scan2024-05-20T04:40:12+00:00
Next Scan 2024-06-19T04:40:12+00:00

Last Scan

Scanned2024-05-20T04:40:12+00:00
URL https://burton.cl/robots.txt
Redirect https://www.burton.cl/robots.txt
Redirect Domain www.burton.cl
Redirect Base burton.cl
Domain IPs 34.176.207.22
Redirect IPs 2600:9000:2003:1600:10:994c:f740:93a1, 2600:9000:2003:3400:10:994c:f740:93a1, 2600:9000:2003:3800:10:994c:f740:93a1, 2600:9000:2003:400:10:994c:f740:93a1, 2600:9000:2003:5c00:10:994c:f740:93a1, 2600:9000:2003:8c00:10:994c:f740:93a1, 2600:9000:2003:8e00:10:994c:f740:93a1, 2600:9000:2003:c00:10:994c:f740:93a1, 52.84.229.110, 52.84.229.20, 52.84.229.21, 52.84.229.92
Response IP 52.84.229.20
Found Yes
Hash 0d50972ae1355226f0ef21df5b53cfb8a9ae1bf19ca235e8abe2c6d4e44522b4
SimHash e410cd574dd0

Groups

*

Rule Path
Disallow /img/*
Disallow /account/*
Disallow /login/*
Disallow /checkout/*
Disallow /busca/*
Disallow /quick-view/*
Disallow /espiar/*

Other Records

Field Value
sitemap https://burtoncl.myvtex.com/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.

Warnings

  • `noindex` is not a known field.