taverniti.com.ar
robots.txt

Robots Exclusion Standard data for taverniti.com.ar

Resource Scan

Scan Details

Site Domain taverniti.com.ar
Base Domain taverniti.com.ar
Scan Status Ok
Last Scan2024-10-17T06:09:55+00:00
Next Scan 2024-11-16T06:09:55+00:00

Last Scan

Scanned2024-10-17T06:09:55+00:00
URL https://www.taverniti.com.ar/robots.txt
Domain IPs 13.33.30.122, 13.33.30.128, 13.33.30.57, 13.33.30.74, 2600:9000:229f:3e00:1e:9a1e:25c0:93a1, 2600:9000:229f:4400:1e:9a1e:25c0:93a1, 2600:9000:229f:5c00:1e:9a1e:25c0:93a1, 2600:9000:229f:a600:1e:9a1e:25c0:93a1, 2600:9000:229f:ae00:1e:9a1e:25c0:93a1, 2600:9000:229f:c00:1e:9a1e:25c0:93a1, 2600:9000:229f:ec00:1e:9a1e:25c0:93a1, 2600:9000:229f:f000:1e:9a1e:25c0:93a1
Response IP 13.33.30.128
Found Yes
Hash c6d24b90ca9fe222616df7dd7fa1413e6583a84484f3e0d4ce306c71b784af45
SimHash 3750e892d891

Groups

*

Rule Path
Disallow /checkout
Disallow /img/
Disallow /Busca/
Disallow /Quick-View/
Disallow /Control/
Disallow /Site/Servicos.aspx
Disallow /Site/TagsMaisPopulares.aspx
Disallow /Site/QuickView.aspx
Disallow /Site/Produto_Listas.aspx
Disallow /Site/ProdutoFrete.aspx
Disallow /Site/TagDetalhe.aspx

Other Records

Field Value
sitemap /sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.