taverniti.com.ar
robots.txt

Robots Exclusion Standard data for taverniti.com.ar

Resource Scan

Scan Details

Site Domain taverniti.com.ar
Base Domain taverniti.com.ar
Scan Status Ok
Last Scan2024-09-17T05:33:13+00:00
Next Scan 2024-10-17T05:33:13+00:00

Last Scan

Scanned2024-09-17T05:33:13+00:00
URL https://www.taverniti.com.ar/robots.txt
Response IP 13.35.18.31
Found Yes
Hash c6d24b90ca9fe222616df7dd7fa1413e6583a84484f3e0d4ce306c71b784af45
SimHash 3750e892d891

Groups

*

Rule Path
Disallow /checkout
Disallow /img/
Disallow /Busca/
Disallow /Quick-View/
Disallow /Control/
Disallow /Site/Servicos.aspx
Disallow /Site/TagsMaisPopulares.aspx
Disallow /Site/QuickView.aspx
Disallow /Site/Produto_Listas.aspx
Disallow /Site/ProdutoFrete.aspx
Disallow /Site/TagDetalhe.aspx

Other Records

Field Value
sitemap /sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.