forumedia.ru
robots.txt
Robots Exclusion Standard data for forumedia.ru
Resource Scan
Scan Details
| Site Domain | forumedia.ru |
| Base Domain | forumedia.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-24T06:15:09+00:00 |
| Next Scan | 2024-11-23T06:15:09+00:00 |
Last Scan
| Scanned | 2024-10-24T06:15:09+00:00 |
| URL | https://forumedia.ru/robots.txt |
| Redirect | https://www.forumedia.ru/robots.txt |
| Redirect Domain | www.forumedia.ru |
| Redirect Base | forumedia.ru |
| Domain IPs | 2a00:15f8:a000:5:1:11:8:54b, 2a00:15f8:a000:5:1:12:8:54b, 2a00:15f8:a000:5:1:13:8:54b, 2a00:15f8:a000:5:1:14:8:54b, 90.156.201.105, 90.156.201.114, 90.156.201.118, 90.156.201.51 |
| Redirect IPs | 2a00:15f8:a000:5:1:11:8:54b, 2a00:15f8:a000:5:1:12:8:54b, 2a00:15f8:a000:5:1:13:8:54b, 2a00:15f8:a000:5:1:14:8:54b, 90.156.201.105, 90.156.201.114, 90.156.201.118, 90.156.201.51 |
| Response IP | 90.156.201.118 |
| Found | Yes |
| Hash | 66636039e9342b3fb84b8c49acf9f7a01e388f14cafd2410a4a706709355c782 |
| SimHash | 318c4655ce97 |
Groups
*
| Product | Comment |
|---|---|
| * | правила для всех роботов |
| Rule | Path | Comment |
|---|---|---|
| Disallow | /cgi-bin | папка на хостинге |
| Disallow | /bitrix/ | папка с системными файлами битрикса |
| Disallow | *bitrix_*%3D | GET-запросы битрикса |
| Disallow | /local/ | папка с системными файлами битрикса |
| Disallow | /*index.php$ | дубли страниц index.php |
| Disallow | /auth/ | авторизация |
| Disallow | *auth%3D | авторизация |
| Disallow | /personal/ | личный кабинет |
| Disallow | *register%3D | регистрация |
| Disallow | *forgot_password%3D | забыли пароль |
| Disallow | *change_password%3D | изменить пароль |
| Disallow | *login%3D | логин |
| Disallow | *logout%3D | выход |
| Disallow | */search/ | поиск |
| Disallow | *action%3D | действия |
| Disallow | *print%3D | печать |
| Disallow | *?new=Y | новая страница |
| Disallow | *?edit= | редактирование |
| Disallow | *?preview= | предпросмотр |
| Disallow | *backurl%3D | трекбеки |
| Disallow | *back_url%3D | трекбеки |
| Disallow | *back_url_admin%3D | трекбеки |
| Disallow | *captcha | каптча |
| Disallow | */feed | все фиды |
| Disallow | */rss | rss фид |
| Disallow | *?FILTER*= | здесь и ниже различные популярные параметры фильтров |
| Disallow | *?ei= | - |
| Disallow | *?p= | - |
| Disallow | *?q= | - |
| Disallow | *?tags= | - |
| Disallow | *B_ORDER%3D | - |
| Disallow | *BRAND%3D | - |
| Disallow | *CLEAR_CACHE%3D | - |
| Disallow | *ELEMENT_ID%3D | - |
| Disallow | *price_from%3D | - |
| Disallow | *price_to%3D | - |
| Disallow | *PROPERTY_TYPE%3D | - |
| Disallow | *PROPERTY_WIDTH%3D | - |
| Disallow | *PROPERTY_HEIGHT%3D | - |
| Disallow | *PROPERTY_DIA%3D | - |
| Disallow | *PROPERTY_OPENING_COUNT%3D | - |
| Disallow | *PROPERTY_SELL_TYPE%3D | - |
| Disallow | *PROPERTY_MAIN_TYPE%3D | - |
| Disallow | *PROPERTY_PRICE%5B*%5D%3D | - |
| Disallow | *S_LAST%3D | - |
| Disallow | *SECTION_ID%3D | - |
| Disallow | *SECTION%5B*%5D%3D | - |
| Disallow | *SHOWALL%3D | - |
| Disallow | *SHOW_ALL%3D | - |
| Disallow | *SHOWBY%3D | - |
| Disallow | *SORT%3D | - |
| Disallow | *SPHRASE_ID%3D | - |
| Disallow | *TYPE%3D | - |
| Disallow | *utm*%3D | ссылки с utm-метками |
| Disallow | *openstat%3D | ссылки с метками openstat |
| Disallow | *from%3D | ссылки с метками from |
| Allow | */upload/ | открываем папку с файлами uploads |
| Allow | /bitrix/*.js | здесь и далее открываем для индексации скрипты |
| Allow | /bitrix/*.css | - |
| Allow | /local/*.js | - |
| Allow | /local/*.css | - |
| Allow | /local/*.jpg | - |
| Allow | /local/*.jpeg | - |
| Allow | /local/*.png | - |
| Allow | /local/*.gif | - |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.forumedia.ru/sitemap.xml |