mercadolibre.com.mx
robots.txt

Robots Exclusion Standard data for mercadolibre.com.mx

Resource Scan

Scan Details

Site Domain mercadolibre.com.mx
Base Domain mercadolibre.com.mx
Scan Status Ok
Last Scan2024-09-21T03:51:45+00:00
Next Scan 2024-09-28T03:51:45+00:00

Last Scan

Scanned2024-09-21T03:51:45+00:00
URL https://mercadolibre.com.mx/robots.txt
Redirect https://www.mercadolibre.com.mx/robots.txt
Redirect Domain www.mercadolibre.com.mx
Redirect Base mercadolibre.com.mx
Domain IPs 13.33.30.114, 13.33.30.37, 13.33.30.69, 13.33.30.8
Redirect IPs 13.33.30.114, 13.33.30.37, 13.33.30.69, 13.33.30.8
Response IP 13.33.30.69
Found Yes
Hash fbe6e509021fb322fde07417e1b03fdde2d172833c1322aaf9ef1d5cf4964980
SimHash 1d58da8484f6

Groups

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

facebookexternalhit
facebookbot
twitterbot
linkedinbot

Rule Path
Disallow

*

Rule Path
Disallow /HOME/
Disallow /gz/merch/
Disallow /gz/menu
Disallow /gz/webdevice/config
Disallow /gz/referidos
Disallow /*www.siteinfo.cf
Disallow /gz/cart/
Disallow /gz/checkout/
Disallow /gz/user-logged
Disallow /gz/shipping-selector
Disallow /gz/navigation/searches/last
Disallow /perfil/vendedor/
Disallow /perfil/comprador/
Disallow /perfil/profile/
Disallow /perfil/jm/profile
Disallow /perfil/ALEXSETHMS
Disallow /noindex/
Disallow /navigation/
Disallow /*itemid
Disallow /*/jm/item
Disallow /recommendations*
Disallow /org-img/html/
Disallow /registration?confirmation_url*
Disallow /home/recommendations
Disallow /social/
Disallow /adn/api*
Disallow /product-fe-recommendations/recommendations*
Disallow /*.js