sb.by
robots.txt
Robots Exclusion Standard data for sb.by
Resource Scan
Scan Details
| Site Domain | sb.by |
| Base Domain | sb.by |
| Scan Status | Ok |
| Last Scan | 2024-09-24T09:57:34+00:00 |
| Next Scan | 2024-10-01T09:57:34+00:00 |
Last Scan
| Scanned | 2024-09-24T09:57:34+00:00 |
| URL | https://sb.by/robots.txt |
| Redirect | https://www.sb.by/robots.txt |
| Redirect Domain | www.sb.by |
| Redirect Base | sb.by |
| Domain IPs | 91.215.43.192 |
| Redirect IPs | 91.215.43.192 |
| Response IP | 91.215.43.192 |
| Found | Yes |
| Hash | 25395a64d8cfc6668ff07ce43cfb4a4622168d6515f6aa67925940f8fcfef35b |
| SimHash | 0cd191f17115 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Allow | */rss |
| Allow | /rss |
| Allow | /bitrix/components/ |
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/panel/ |
| Allow | /local/templates/html_dev/images/ |
| Allow | /local/templates/html_dev/css/ |
| Allow | /local/templates/html_dev/js/ |
| Disallow | /bitrix/admin/ |
| Disallow | /bitrix/redirect.php |
| Disallow | /bitrix/rk.php |
| Disallow | /bitrix/click.php |
| Disallow | /?page* |
| Disallow | /?commentId=* |
| Disallow | /?delete_comment_id=* |
| Disallow | *?delete_comment_id=* |
| Disallow | *?commentId=* |
| Disallow | *?page=user&* |
| Disallow | *?page=user* |
| Disallow | /area/* |
| Disallow | /?area* |
| Disallow | /SECTION* |
| Disallow | /print* |
| Disallow | /ru* |
| Disallow | */article.php* |
| Disallow | */index.php |
| Disallow | /bitrix/ |
| Disallow | /*show_include_exec_time%3D |
| Disallow | /*show_page_exec_time%3D |
| Disallow | /*show_sql_stat%3D |
| Disallow | /*bitrix_include_areas%3D |
| Disallow | /*clear_cache%3D |
| Disallow | /*clear_cache_session%3D |
| Disallow | /*ADD_TO_COMPARE_LIST |
| Disallow | /*ORDER_BY |
| Disallow | /*PAGEN |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*print_course%3D |
| Disallow | /*?action= |
| Disallow | /*%26action%3D |
| Disallow | /*register%3D |
| Disallow | /*forgot_password%3D |
| Disallow | /*change_password%3D |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*auth%3D |
| Disallow | /*backurl%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*?utm_source= |
| Disallow | /admin-ko |
| Disallow | /.git |
| Disallow | /mailru |
| Disallow | /tv_parser |
| Disallow | /subscribe |
| Disallow | /search |
| Disallow | /moderator |
| Disallow | /*AJAX_MONTH |
| Disallow | /*?date= |
| Disallow | /*?from= |
| Disallow | /articles/umer-akter-iz-serialov-glukhar-i-kadetstvo-sergey-talanov-2.html |
| Disallow | /include/html_parts/* |
yandex
| Rule | Path |
|---|---|
| Allow | /yandexrss/last/ |
| Allow | /yandexrss/spetsnaz/ |
| Allow | /bitrix/components/ |
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/panel/ |
| Allow | /local/templates/html_dev/images/ |
| Allow | /local/templates/html_dev/css/ |
| Allow | /local/templates/html_dev/js/ |
| Disallow | /area/* |
| Disallow | /?page* |
| Disallow | /?commentId=* |
| Disallow | /?delete_comment_id=* |
| Disallow | *?delete_comment_id=* |
| Disallow | *?commentId=* |
| Disallow | *?page=user* |
| Disallow | /?area* |
| Disallow | */index.php |
| Disallow | /SECTION* |
| Disallow | /print* |
| Disallow | /ru* |
| Disallow | */article.php* |
| Disallow | /bitrix/ |
| Disallow | /*show_include_exec_time%3D |
| Disallow | /*show_page_exec_time%3D |
| Disallow | /*show_sql_stat%3D |
| Disallow | /*bitrix_include_areas%3D |
| Disallow | /*clear_cache%3D |
| Disallow | /*clear_cache_session%3D |
| Disallow | /*ADD_TO_COMPARE_LIST |
| Disallow | /*ORDER_BY |
| Disallow | /*PAGEN |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*print_course%3D |
| Disallow | /*?action= |
| Disallow | /*%26action%3D |
| Disallow | /*register%3D |
| Disallow | /*forgot_password%3D |
| Disallow | /*change_password%3D |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*auth%3D |
| Disallow | /*backurl%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*?utm_source= |
| Disallow | /admin-ko |
| Disallow | /.git |
| Disallow | /mailru |
| Disallow | /tv_parser |
| Disallow | /subscribe |
| Disallow | /search |
| Disallow | /moderator |
| Disallow | /*AJAX_MONTH |
| Disallow | /*?date= |
| Disallow | /*?from= |
| Disallow | /articles/umer-akter-iz-serialov-glukhar-i-kadetstvo-sergey-talanov-2.html |
| Disallow | /include/html_parts/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.sb.by/sitemap.xml |
| sitemap | https://www.sb.by/news-rss/google-xml/ |
| sitemap | https://goroskop.sb.by/sitemap.xml |
| sitemap | https://www.sb.by/sitemap.xml |
| sitemap | https://www.sb.by/sitemap.xml |
| sitemap | https://www.sb.by/news-rss/google-xml/ |
| sitemap | https://www.sb.by/news-rss/google-xml/ |
Warnings
- `clean-param` is not a known field.
Comments