besthard.ru
robots.txt
Robots Exclusion Standard data for besthard.ru
Resource Scan
Scan Details
| Site Domain | besthard.ru |
| Base Domain | besthard.ru |
| Scan Status | Ok |
| Last Scan | 2026-03-01T13:46:20+00:00 |
| Next Scan | 2026-03-31T13:46:20+00:00 |
Last Scan
| Scanned | 2026-03-01T13:46:20+00:00 |
| URL | https://besthard.ru/robots.txt |
| Domain IPs | 2a00:15f8:a000:5:1:11:7:3a31, 2a00:15f8:a000:5:1:12:7:3a31, 2a00:15f8:a000:5:1:13:7:3a31, 2a00:15f8:a000:5:1:14:7:3a31, 90.156.201.103, 90.156.201.113, 90.156.201.77, 90.156.201.79 |
| Response IP | 90.156.201.113 |
| Found | Yes |
| Hash | da4a765b8c756e58604c7405fcb8bba9f41af166f3bce9335877a3b53f825835 |
| SimHash | c78510c7c2b4 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /new/* |
| Disallow | /new2/* |
| Disallow | /new/my/ |
| Disallow | /new/checkout/ |
| Disallow | /*?roistat= |
| Disallow | /*?sort= |
| Disallow | /*?click_id= |
| Disallow | /*?pm_source= |
| Disallow | /*?promo_id= |
| Disallow | /*?source_type= |
| Disallow | /*?tip_litsenzii1%5B%5D= |
| Disallow | /*?vendor= |
| Disallow | /*?s |
| Disallow | /*?s= |
| Disallow | /*?sku= |
| Disallow | /*?k50id= |
| Disallow | /*?clid= |
| Disallow | /*?scid= |
| Disallow | /prices/ |
| Disallow | /admin/ |
| Disallow | /my/ |
| Disallow | /signup/ |
| Disallow | /login/ |
| Disallow | /forgotpassword/ |
| Disallow | /author/ |
| Disallow | /checkout/ |
| Disallow | /cart/ |
| Disallow | /onestep/ |
| Disallow | /parser/ |
| Disallow | /search/ |
| Disallow | /webasyst/ |
| Disallow | */clck.yandex.ru/redir/ |
| Disallow | /qwe/ |
| Disallow | /compare/ |
| Disallow | /tag/* |
| Disallow | *?_escaped_fragment_=* |
| Disallow | /mailer/unsubscribe/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /new/* |
| Disallow | /new2/* |
| Disallow | /new/my/ |
| Disallow | /new/checkout/ |
| Disallow | /*?roistat= |
| Disallow | /*?sort= |
| Disallow | /*?click_id= |
| Disallow | /*?pm_source= |
| Disallow | /*?promo_id= |
| Disallow | /*?source_type= |
| Disallow | /*?tip_litsenzii1%5B%5D= |
| Disallow | /*?vendor= |
| Disallow | /*?s= |
| Disallow | /*?k50id= |
| Disallow | /*?clid= |
| Disallow | /*?scid= |
| Disallow | /prices/ |
| Disallow | /admin/ |
| Disallow | /my/ |
| Disallow | /signup/ |
| Disallow | /login/ |
| Disallow | /forgotpassword/ |
| Disallow | /author/ |
| Disallow | /checkout/ |
| Disallow | /cart/ |
| Disallow | /onestep/ |
| Disallow | /parser/ |
| Disallow | /search/ |
| Disallow | /webasyst/ |
| Disallow | */clck.yandex.ru/redir/ |
| Disallow | /qwe/ |
| Disallow | /compare/ |
| Disallow | /tag/* |
| Disallow | *?_escaped_fragment_=* |
| Disallow | /mailer/unsubscribe/ |
*
| Rule | Path |
|---|---|
| Disallow | /new/* |
| Disallow | /new2/* |
| Disallow | /new/my/ |
| Disallow | /new/checkout/ |
| Disallow | /*?roistat= |
| Disallow | /*?sort= |
| Disallow | /*?click_id= |
| Disallow | /*?pm_source= |
| Disallow | /*?promo_id= |
| Disallow | /*?source_type= |
| Disallow | /*?tip_litsenzii1%5B%5D= |
| Disallow | /*?vendor= |
| Disallow | /*?s= |
| Disallow | /*?k50id= |
| Disallow | /*?clid= |
| Disallow | /*?scid= |
| Disallow | /prices/ |
| Disallow | /admin/ |
| Disallow | /my/ |
| Disallow | /signup/ |
| Disallow | /login/ |
| Disallow | /forgotpassword/ |
| Disallow | /author/ |
| Disallow | /checkout/ |
| Disallow | /cart/ |
| Disallow | /onestep/ |
| Disallow | /parser/ |
| Disallow | /search/ |
| Disallow | /webasyst/ |
| Disallow | */clck.yandex.ru/redir/ |
| Disallow | /qwe/ |
| Disallow | /compare/ |
| Disallow | /tag/* |
| Disallow | *?_escaped_fragment_=* |
| Disallow | /mailer/unsubscribe/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://besthard.ru/sitemap.xml |
| sitemap | https://besthard.ru/faq/sitemap.xml |
| sitemap | https://besthard.ru/sitemap.xml |
| sitemap | https://besthard.ru/faq/sitemap.xml |
| sitemap | https://besthard.ru/sitemap.xml |
| sitemap | https://besthard.ru/faq/sitemap.xml |
Warnings
- `host` is not a known field.
Comments