esteromarket.com
robots.txt

Robots Exclusion Standard data for esteromarket.com

Resource Scan

Scan Details

Site Domain esteromarket.com
Base Domain esteromarket.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-05T04:28:31+00:00
Next Scan 2025-10-04T04:28:31+00:00

Last Successful Scan

Scanned2025-05-31T04:02:58+00:00
URL https://esteromarket.com/robots.txt
Domain IPs 108.138.199.102, 108.138.199.103, 108.138.199.26, 108.138.199.73
Response IP 3.164.206.36
Found Yes
Hash 52aba8d3e33204c2f0875dccb7a6c0b2b88027f9ad4611510a2533b658f97cb8
SimHash cc1cd112cc71

Groups

blexbot
seznambot
ccbot
spbot
semrushbot
mj12bot
baiduspider
yandex
mauibot
linguee

Rule Path
Disallow /

*

Rule Path
Disallow /catalogsearch
Disallow /api/
Disallow /checkout/
Disallow /customer/
Disallow /dashboard/
Disallow /index.php/
Disallow /fcc/
Allow /customer/account/login/
Disallow *%26amp%3B*
Allow /*?p=
Allow /join/*?
Disallow /*?

storebot-google

Rule Path
Disallow /catalogsearch
Disallow /api/
Disallow /customer/
Disallow /dashboard/
Disallow /index.php/
Disallow /fcc/
Allow /customer/account/login/
Disallow *%26amp%3B*
Allow /*?p=
Disallow /*?

Other Records

Field Value
sitemap https://esteromarket.com/sitemap_index.xml

Comments

  • Disallow SalesForce Marketing Cloud links that appear to escape URLs
  • Disallow platform-specific URLs that come across as a query string,
  • but allow pagination (`?p=[d]`)