mercadolibre.co.cr
robots.txt

Robots Exclusion Standard data for mercadolibre.co.cr

Resource Scan

Scan Details

Site Domain mercadolibre.co.cr
Base Domain mercadolibre.co.cr
Scan Status Ok
Last Scan2024-11-15T12:22:58+00:00
Next Scan 2024-11-22T12:22:58+00:00

Last Scan

Scanned2024-11-15T12:22:58+00:00
URL https://mercadolibre.co.cr/robots.txt
Redirect https://www.mercadolibre.co.cr/robots.txt
Redirect Domain www.mercadolibre.co.cr
Redirect Base mercadolibre.co.cr
Domain IPs 13.35.186.73, 13.35.186.76, 13.35.186.79, 13.35.186.84
Redirect IPs 13.33.28.106, 13.33.28.127, 13.33.28.16, 13.33.28.93
Response IP 13.33.28.16
Found Yes
Hash fbe6e509021fb322fde07417e1b03fdde2d172833c1322aaf9ef1d5cf4964980
SimHash 1d58da8484f6

Groups

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

facebookexternalhit
facebookbot
twitterbot
linkedinbot

Rule Path
Disallow

*

Rule Path
Disallow /HOME/
Disallow /gz/merch/
Disallow /gz/menu
Disallow /gz/webdevice/config
Disallow /gz/referidos
Disallow /*www.siteinfo.cf
Disallow /gz/cart/
Disallow /gz/checkout/
Disallow /gz/user-logged
Disallow /gz/shipping-selector
Disallow /gz/navigation/searches/last
Disallow /perfil/vendedor/
Disallow /perfil/comprador/
Disallow /perfil/profile/
Disallow /perfil/jm/profile
Disallow /perfil/ALEXSETHMS
Disallow /noindex/
Disallow /navigation/
Disallow /*itemid
Disallow /*/jm/item
Disallow /recommendations*
Disallow /org-img/html/
Disallow /registration?confirmation_url*
Disallow /home/recommendations
Disallow /social/
Disallow /adn/api*
Disallow /product-fe-recommendations/recommendations*
Disallow /*.js