e-stock.by
robots.txt

Robots Exclusion Standard data for e-stock.by

Resource Scan

Scan Details

Site Domain e-stock.by
Base Domain e-stock.by
Scan Status Ok
Last Scan2026-02-01T00:26:38+00:00
Next Scan 2026-03-03T00:26:38+00:00

Last Scan

Scanned2026-02-01T00:26:38+00:00
URL https://e-stock.by/robots.txt
Domain IPs 178.172.217.60
Response IP 178.172.217.60
Found Yes
Hash 7b65be7e1a98e5e877de052891e09a2d7c25404a026c39d941fe49bf48b0a34e
SimHash 4f14c401c698

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Disallow /*action%3Dyith-woocompare-add-product*
Disallow /*add-to-cart%3D
Disallow /author/admin/
Allow /

bingbot

Rule Path
Disallow /*action%3Dyith-woocompare-add-product*
Disallow /*add-to-cart%3D
Disallow /author/admin/
Allow /

yandex

Rule Path
Disallow /wp-admin/
Disallow /cgi-bin/
Disallow /search
Disallow /tag/
Disallow /author/
Disallow /feed/
Disallow /trackback/
Disallow /wp-content/plugins/
Disallow /wp-json/
Disallow /*?orderby=
Disallow /*?filter
Disallow /*add-to-cart%3D
Disallow /*action%3Dyith-woocompare-add-product*
Disallow /author/admin/
Disallow /*?*
Allow /$
Allow /product/

Other Records

Field Value
crawl-delay 10

mail.ru_bot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

cocolyzebot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://example.com/sitemap_index.xml

Comments

  • == Общие правила для всеÑ
  • == Разрешить GoogleBot всё ==
  • == Разрешить BingBot всё ==
  • == Ограничить Yandex: только карточки и главная ==
  • == Запретить Mail.ru ==
  • == Запретить PetalBot ==
  • == Запретить SemrushBot ==
  • == Запретить DotBot ==
  • == Запретить AhrefsBot ==
  • == Запретить MJ12bot ==
  • == Запретить Cocolyzebot ==
  • == Sitemap ==

Warnings

  • 2 invalid lines.