esthederm.pt
robots.txt

Robots Exclusion Standard data for esthederm.pt

Resource Scan

Scan Details

Site Domain esthederm.pt
Base Domain esthederm.pt
Scan Status Ok
Last Scan2025-12-29T23:20:33+00:00
Next Scan 2026-01-28T23:20:33+00:00

Last Scan

Scanned2025-12-29T23:20:33+00:00
URL https://esthederm.pt/robots.txt
Redirect https://www.esthederm.pt/robots.txt
Redirect Domain www.esthederm.pt
Redirect Base esthederm.pt
Domain IPs 2402:1f00:8001:320::80, 2402:1f00:8001:320::90, 51.79.216.172, 51.79.216.173
Redirect IPs 2604:2dc0:100:2f14::80, 2604:2dc0:100:2f14::90, 51.79.216.172, 51.79.216.173
Response IP 51.79.216.172
Found Yes
Hash bf4824ab7c453a40db6f301e1ff4ffc25a4d7450127ffcb473684d9635df0b9b
SimHash 8f20b17187d1

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /gestion/
Disallow /app/
Disallow /downloader/
Disallow /errors/
Disallow /pkginfo/
Disallow /shell/
Disallow /*?dir*
Disallow /*?dir=desc
Disallow /*?dir=asc
Disallow /*?limit=all
Disallow /*?mode*
Disallow /*?___from_store=*
Disallow /*?cat=*
Disallow /*?q=*
Disallow /index.php/
Disallow /*?SID=
Disallow /checkout/
Disallow /onestepcheckout/
Disallow /customer/
Disallow /customer/account/
Disallow /customer/account/login/
Disallow /catalogsearch/
Disallow /catalog/product_compare/
Disallow /catalog/category/view/
Disallow /catalog/product/view/
Disallow /catalog/product/gallery/
Disallow /poll/
Disallow /review/
Disallow /sendfriend/
Disallow /tag/
Disallow /wishlist/
Disallow /ajax/
Disallow /ajaxwishlist/
Disallow /priceslider/

Other Records

Field Value
sitemap https://www.esthederm.pt/media/sitemap/sitemap_pt.xml

Comments

  • DEVELOPMENT RELATED SETTINGS
  • Do not crawl admin page
  • Do not crawl common technical folders
  • Do not crawl sub category pages that are sorted or filtered.
  • Do not crawl 2-nd home page copy (example.com/index.php/). Uncomment it only if you activated SEO URLs.
  • Do not crawl links with session IDs
  • Do not crawl checkout and user account pages
  • Do not crawl seach pages and not-SEO catalog links
  • Do not crawl ajax requests