xlshop.com.ar
robots.txt

Robots Exclusion Standard data for xlshop.com.ar

Resource Scan

Scan Details

Site Domain xlshop.com.ar
Base Domain xlshop.com.ar
Scan Status Ok
Last Scan2024-09-24T00:50:21+00:00
Next Scan 2024-10-24T00:50:21+00:00

Last Scan

Scanned2024-09-24T00:50:21+00:00
URL https://www.xlshop.com.ar/robots.txt
Domain IPs 13.35.238.120, 13.35.238.66, 13.35.238.76, 13.35.238.81, 2600:9000:2085:0:9:69bb:20c0:93a1, 2600:9000:2085:3000:9:69bb:20c0:93a1, 2600:9000:2085:3800:9:69bb:20c0:93a1, 2600:9000:2085:5c00:9:69bb:20c0:93a1, 2600:9000:2085:8a00:9:69bb:20c0:93a1, 2600:9000:2085:d000:9:69bb:20c0:93a1, 2600:9000:2085:d600:9:69bb:20c0:93a1, 2600:9000:2085:f600:9:69bb:20c0:93a1
Response IP 13.35.238.66
Found Yes
Hash bf0e326bd6edba25bdf6d8bce3488678470bd9edfd4565ecce915dcde54f37d4
SimHash 31d0a8d6d8b4

Groups

*

Rule Path
Disallow /*/login$
Disallow /Site/Servicos.aspx
Disallow /Control/
Disallow /Site/TagsMaisPopulares.aspx
Disallow /Site/QuickView.aspx
Disallow /Site/Produto_Listas.aspx
Disallow /Site/ProdutoFrete.aspx
Disallow /Site/TagDetalhe.aspx
Disallow /quick-view
Disallow /carteras/bandoleras/mochilas?O=OrderByReleaseDateDESC&initialMap=c&initialQuery=carteras&map=category-1%2Ccategory-2%2Ccategory-2

Other Records

Field Value
sitemap https://www.xlshop.com.ar/sitemap.xml

Comments

  • Disallow all crawlers access to certain pages.