glavbusina.ru
robots.txt
Robots Exclusion Standard data for glavbusina.ru
Resource Scan
Scan Details
| Site Domain | glavbusina.ru |
| Base Domain | glavbusina.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-07T05:35:49+00:00 |
| Next Scan | 2024-07-07T05:35:49+00:00 |
Last Scan
| Scanned | 2024-06-07T05:35:49+00:00 |
| URL | https://glavbusina.ru/robots.txt |
| Domain IPs | 92.38.128.246, 92.38.128.27 |
| Response IP | 92.38.128.27 |
| Found | Yes |
| Hash | 9cb0bcf9e6d45a9c4c6245b8c6e1c85f8bb4f2a07b35f6497d29a61573896956 |
| SimHash | 82ec9dc7ee11 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /auth/ |
| Disallow | /bitrix/ |
| Disallow | /local/ |
| Disallow | /login/ |
| Disallow | /personal/ |
| Disallow | /search/ |
| Disallow | /a/ |
| Disallow | /stat/ |
| Disallow | /news/ |
| Disallow | /gb/* |
| Disallow | /index/ |
| Disallow | /load/ |
| Disallow | /online/ |
| Disallow | /photo |
| Disallow | /shop/ |
| Disallow | /publ/ |
| Disallow | /reviews |
| Disallow | /forum |
| Disallow | /panel/ |
| Disallow | /admin/ |
| Disallow | /secure/ |
| Disallow | /informer/ |
| Disallow | /mchat |
| Disallow | /abnl/ |
| Disallow | |
| Disallow | |
| Disallow | |
| Disallow | /yandex/ |
| Disallow | /vkontakte |
| Disallow | /temp |
| Disallow | /users |
| Disallow | /social/* |
| Disallow | /include/* |
| Disallow | /desctop_app/* |
| Disallow | /tovary-so-skidkami2.php |
| Disallow | /forma_obratnoy_svayzi |
| Disallow | /lidery_prodazh |
| Disallow | *?* |
| Disallow | *PAGEN* |
| Disallow | /catalogfoto |
| Disallow | /store |
| Disallow | /?ssid= |
| Disallow | *catalog_filter_pf* |
| Disallow | *SORT%3D* |
| Disallow | *set_filter%3D* |
| Disallow | *f_art%3D* |
| Disallow | *f_other1%3D* |
| Disallow | *f_other2%3D* |
| Disallow | *f_other3%3D* |
| Disallow | *f_other4%3D* |
| Disallow | *f_other5%3D* |
| Disallow | *f_other6%3D* |
| Disallow | *f_other7%3D* |
| Disallow | *f_other8%3D* |
| Disallow | *f_other9%3D* |
| Disallow | *.php$ |
| Disallow | *.pdf$ |
| Disallow | *.xls$ |
| Disallow | */index.php$ |
| Disallow | */404.php$ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 0.2 |
yandex
| Rule | Path |
|---|---|
| Disallow | /auth/ |
| Disallow | /bitrix/ |
| Disallow | /local/ |
| Disallow | /login/ |
| Disallow | /personal/ |
| Disallow | /search/ |
| Disallow | /a/ |
| Disallow | /stat/ |
| Disallow | /news/ |
| Disallow | /gb/* |
| Disallow | /index/ |
| Disallow | /load/ |
| Disallow | /online/ |
| Disallow | /photo |
| Disallow | /shop/ |
| Disallow | /publ/ |
| Disallow | /reviews |
| Disallow | /forum |
| Disallow | /panel/ |
| Disallow | /admin/ |
| Disallow | /secure/ |
| Disallow | /informer/ |
| Disallow | /mchat |
| Disallow | /abnl/ |
| Disallow | |
| Disallow | |
| Disallow | |
| Disallow | /yandex/ |
| Disallow | /vkontakte |
| Disallow | /temp |
| Disallow | /users |
| Disallow | /social/* |
| Disallow | /include/* |
| Disallow | /desctop_app/* |
| Disallow | /tovary-so-skidkami2.php |
| Disallow | /forma_obratnoy_svayzi |
| Disallow | /lidery_prodazh |
| Disallow | *?* |
| Disallow | *PAGEN* |
| Disallow | /catalogfoto |
| Disallow | /store |
| Disallow | /?ssid= |
| Disallow | *catalog_filter_pf* |
| Disallow | *SORT%3D* |
| Disallow | *set_filter%3D* |
| Disallow | *f_art%3D* |
| Disallow | *f_other1%3D* |
| Disallow | *f_other2%3D* |
| Disallow | *f_other3%3D* |
| Disallow | *f_other4%3D* |
| Disallow | *f_other5%3D* |
| Disallow | *f_other6%3D* |
| Disallow | *f_other7%3D* |
| Disallow | *f_other8%3D* |
| Disallow | *f_other9%3D* |
| Disallow | *.php$ |
| Disallow | *.pdf$ |
| Disallow | *.xls$ |
| Disallow | */index.php$ |
| Disallow | */404.php$ |
Other Records
| Field | Value |
|---|---|
| sitemap | http://glavbusina.ru/sitemap.xml |
Warnings
- 4 invalid lines.
- `clean-param` is not a known field.
Comments