shop.by
robots.txt
Robots Exclusion Standard data for shop.by
Resource Scan
Scan Details
| Site Domain | shop.by |
| Base Domain | shop.by |
| Scan Status | Ok |
| Last Scan | 2024-11-12T13:47:18+00:00 |
| Next Scan | 2024-11-19T13:47:18+00:00 |
Last Scan
| Scanned | 2024-11-12T13:47:18+00:00 |
| URL | https://shop.by/robots.txt |
| Domain IPs | 93.85.84.87 |
| Response IP | 93.85.84.87 |
| Found | Yes |
| Hash | 084f227546a25eff16b68cbafba011db1a365ba731bd6d2a95779ee3987f2877 |
| SimHash | 5c19935b164b |
Groups
*
| Rule | Path |
|---|---|
| Allow | *.js |
| Allow | *.css |
| Allow | */?page_id= |
| Disallow | *yadclid%3D* |
| Disallow | *yadordid%3D* |
| Disallow | /cgi-bin/ |
| Disallow | /abc/* |
| Disallow | */news/index/ |
| Disallow | */office/ |
| Disallow | */instruction/ |
| Disallow | */remark_model/ |
| Disallow | */remark/ |
| Disallow | */dogovor/ |
| Disallow | */passport/ |
| Disallow | */settings/ |
| Disallow | */shop_locked/ |
| Disallow | */list/* |
| Disallow | */js/noindex/ |
| Disallow | */find_tips/ |
| Disallow | */model/* |
| Disallow | */shopinfo.php |
| Disallow | */item.php |
| Disallow | */to.php |
| Disallow | */find/* |
| Disallow | *sort%3D* |
| Disallow | *to_order%3D* |
| Disallow | *page_size%3D* |
| Disallow | *eshop_prof* |
| Disallow | *action%3D* |
| Disallow | *essense_id%3D* |
| Disallow | *currency%3D* |
| Disallow | *price_before%3D* |
| Disallow | *price_after%3D* |
| Disallow | *?findtext=* |
| Disallow | *?print* |
| Disallow | *?adv_code=* |
| Disallow | *?data_mode=* |
| Disallow | *mode%3D* |
| Disallow | *?tabview=* |
| Disallow | *?top=* |
| Disallow | */news/poisk-po-tegam* |
| Disallow | */news.php* |
| Disallow | *?id=* |
| Disallow | */informacya/pokupatelyu/novoe/ |
| Disallow | *?promotion=* |
| Disallow | */management/* |
| Disallow | */manager/* |
| Disallow | */?bug=* |
| Disallow | */?SETCITY=* |
| Disallow | *.html |
| Disallow | */?* |
| Disallow | *spec_offer* |
| Disallow | */internet_magaziny/ |
| Disallow | *?lite* |
| Disallow | *?in_sale_only* |
| Disallow | *pics/newmain* |
| Disallow | */vk_wid.php |
| Disallow | */types_list/* |
| Disallow | */ssi/* |
| Disallow | */cart/* |
| Disallow | */ajax/modelOffers/* |
| Disallow | */shcart/* |
| Disallow | */order/* |
| Disallow | *?_openstat* |
| Disallow | *?action* |
| Disallow | */bookmarks/* |
| Disallow | */ajax/pretype_shops/* |
| Disallow | */ajax/analytics/* |
| Disallow | *?site_url=* |
yandex
| Rule | Path |
|---|---|
| Allow | */?page_id= |
| Disallow | /cgi-bin/ |
| Disallow | /abc/* |
| Disallow | */news/index/ |
| Disallow | */office/ |
| Disallow | */instruction/ |
| Disallow | */remark_model/ |
| Disallow | */remark/ |
| Disallow | */dogovor/ |
| Disallow | */passport/ |
| Disallow | */settings/ |
| Disallow | */shop_locked/ |
| Disallow | */list/* |
| Disallow | */js/noindex/ |
| Disallow | */find_tips/ |
| Disallow | */model/* |
| Disallow | */shopinfo.php |
| Disallow | */item.php |
| Disallow | */to.php |
| Disallow | */find/* |
| Disallow | *sort%3D* |
| Disallow | *to_order%3D* |
| Disallow | *page_size%3D* |
| Disallow | *eshop_prof* |
| Disallow | *action%3D* |
| Disallow | *essense_id%3D* |
| Disallow | *currency%3D* |
| Disallow | *price_before%3D* |
| Disallow | *price_after%3D* |
| Disallow | *?findtext=* |
| Disallow | *?print* |
| Disallow | *?adv_code=* |
| Disallow | *?data_mode=* |
| Disallow | *mode%3D* |
| Disallow | *?tabview=* |
| Disallow | *?top=* |
| Disallow | */news/poisk-po-tegam* |
| Disallow | */news.php* |
| Disallow | *?id=* |
| Disallow | */informacya/pokupatelyu/novoe/ |
| Disallow | *?promotion=* |
| Disallow | */management/* |
| Disallow | */manager/* |
| Disallow | */?bug=* |
| Disallow | */?SETCITY=* |
| Disallow | */?* |
| Disallow | *.html |
| Disallow | *spec_offer* |
| Disallow | */internet_magaziny/ |
| Disallow | *?lite* |
| Disallow | *?in_sale_only* |
| Disallow | *pics/newmain* |
| Disallow | */vk_wid.php |
| Disallow | */types_list/* |
| Disallow | */ssi/* |
| Disallow | */cart/* |
| Disallow | */shcart/* |
| Disallow | */order/* |
| Disallow | *?_openstat* |
| Disallow | *?action* |
| Disallow | */bookmarks/* |
| Disallow | */ajax/pretype_shops/* |
| Disallow | */ajax/analytics/* |
| Disallow | *?site_url=* |
mail.ru
| Rule | Path |
|---|---|
| Allow | /*?page_id= |
| Disallow | /cgi-bin/ |
| Disallow | /abc/* |
| Disallow | /*news/index/ |
| Disallow | /*office/ |
| Disallow | /*instruction/ |
| Disallow | /*remark_model/ |
| Disallow | /*remark/ |
| Disallow | /*dogovor/ |
| Disallow | /*passport/ |
| Disallow | /*settings/ |
| Disallow | /*shop_locked/ |
| Disallow | /*list/* |
| Disallow | /*js/noindex/ |
| Disallow | /*find_tips/ |
| Disallow | /*model/* |
| Disallow | /*shopinfo.php |
| Disallow | /*item.php |
| Disallow | /*to.php |
| Disallow | /*find/* |
| Disallow | /*sort%3D* |
| Disallow | /*to_order%3D* |
| Disallow | /*page_size%3D* |
| Disallow | /*eshop_prof* |
| Disallow | /*action%3D* |
| Disallow | /*essense_id%3D* |
| Disallow | /*currency%3D* |
| Disallow | /*price_before%3D* |
| Disallow | /*price_after%3D* |
| Disallow | /*?findtext=* |
| Disallow | /*?print* |
| Disallow | /*?adv_code=* |
| Disallow | /*?data_mode=* |
| Disallow | /*mode%3D* |
| Disallow | /*?tabview=* |
| Disallow | /*?top=* |
| Disallow | /*news/poisk-po-tegam* |
| Disallow | */news.php* |
| Disallow | *?id=* |
| Disallow | /*informacya/pokupatelyu/novoe/ |
| Disallow | /*?promotion=* |
| Disallow | /*management/* |
| Disallow | /*manager/* |
| Disallow | /*?bug=* |
| Disallow | /*?SETCITY=* |
| Disallow | *.html |
| Disallow | */?* |
| Disallow | /*spec_offer |
| Disallow | /*internet_magaziny/ |
| Disallow | /*?lite* |
| Disallow | /*?in_sale_only* |
| Disallow | /*pics/newmain* |
| Disallow | /*vk_wid.php |
| Disallow | */types_list/* |
| Disallow | /*ssi/* |
| Disallow | /*cart/* |
| Disallow | /*shcart/* |
| Disallow | /*order/* |
| Disallow | /*?_openstat* |
| Disallow | /*?action* |
| Disallow | /*bookmarks/* |
| Disallow | /*ajax/pretype_shops/* |
| Disallow | /*ajax/analytics/* |
| Disallow | /*?site_url=* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://shop.by/sitemap_main.xml |
Warnings
- `host` is not a known field.