esthederm.com.br
robots.txt

Robots Exclusion Standard data for esthederm.com.br

Resource Scan

Scan Details

Site Domain esthederm.com.br
Base Domain esthederm.com.br
Scan Status Ok
Last Scan2025-12-18T14:01:44+00:00
Next Scan 2026-01-17T14:01:44+00:00

Last Scan

Scanned2025-12-18T14:01:44+00:00
URL https://esthederm.com.br/robots.txt
Redirect https://www.esthederm.com.br/robots.txt
Redirect Domain www.esthederm.com.br
Redirect Base esthederm.com.br
Domain IPs 2402:1f00:8001:320::80, 2402:1f00:8001:320::90, 51.79.216.172, 51.79.216.173
Redirect IPs 2402:1f00:8001:320::80, 2402:1f00:8001:320::90, 51.79.216.172, 51.79.216.173
Response IP 51.79.216.172
Found Yes
Hash f219fa6386f840d94a209331cb34377ecd8ff8c1b08afadfaa96489e9abe5362
SimHash af209370a7d1

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /gestion/
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /pkginfo/
Disallow /shell/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?___from_store=*
Disallow /*?cat=*
Disallow /*?q=*
Disallow /index.php/
Disallow /*?SID=
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalog/product/gallery/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /ajax/
Disallow /ajaxwishlist/
Disallow /priceslider/

Other Records

Field Value
sitemap https://www.esthederm.com.br/media/sitemap/sitemap_br.xml

Comments

  • DEVELOPMENT RELATED SETTINGS
  • Do not crawl admin page
  • Do not crawl common technical folders
  • Do not crawl sub category pages that are sorted or filtered.
  • Do not crawl 2-nd home page copy (example.com/index.php/). Uncomment it only if you activated SEO URLs.
  • Do not crawl links with session IDs
  • Do not crawl checkout and user account pages
  • Do not crawl seach pages and not-SEO catalog links
  • Do not crawl ajax requests