mercadolivre.com.br
robots.txt

Robots Exclusion Standard data for mercadolivre.com.br

Resource Scan

Scan Details

Site Domain mercadolivre.com.br
Base Domain mercadolivre.com.br
Scan Status Ok
Last Scan2024-11-11T20:22:55+00:00
Next Scan 2024-11-18T20:22:55+00:00

Last Scan

Scanned2024-11-11T20:22:55+00:00
URL https://mercadolivre.com.br/robots.txt
Redirect https://www.mercadolivre.com.br/robots.txt
Redirect Domain www.mercadolivre.com.br
Redirect Base mercadolivre.com.br
Domain IPs 15.197.170.90, 3.33.182.45
Redirect IPs 15.197.170.90, 3.33.182.45
Response IP 15.197.170.90
Found Yes
Hash a04e5c0149540d84277953fce17d1d70ba503e754b49ed1acfc91e8d0e08c2c2
SimHash 0558da2584f7

Groups

amazonbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

facebookexternalhit
facebookbot
twitterbot
linkedinbot

Rule Path
Disallow

*

Rule Path
Disallow /HOME/
Disallow /gz/merch/
Disallow /gz/menu
Disallow /gz/webdevice/config
Disallow /gz/referidos
Disallow /*www.siteinfo.cf
Disallow /gz/cart/
Disallow /gz/checkout/
Disallow /gz/user-logged
Disallow /gz/shipping-selector
Disallow /gz/navigation/searches/last
Disallow /perfil/vendedor/
Disallow /perfil/comprador/
Disallow /perfil/profile/
Disallow /perfil/jm/profile
Disallow /perfil/ALEXSETHMS
Disallow /noindex/
Disallow /navigation/
Disallow /*itemid
Disallow /*/jm/item
Disallow /recommendations*
Disallow /org-img/html/
Disallow /registration?confirmation_url*
Disallow /home/recommendations
Disallow /social/
Disallow /adn/api*
Disallow /product-fe-recommendations/recommendations*
Disallow /*.js
Disallow /*/p/MLB*/s
Disallow /*/p/MLB*/seller-info
Disallow /*/p/MLB*/specifications
Disallow /anuncie
Disallow /gz/
Disallow /blog/cg-*
Disallow /mais-vendidos/MLB
Disallow /ofertas?
Allow /home/recommendations/pom