nordast.ru
robots.txt

Robots Exclusion Standard data for nordast.ru

Resource Scan

Scan Details

Site Domain nordast.ru
Base Domain nordast.ru
Scan Status Ok
Last Scan2024-04-25T16:11:47+00:00
Next Scan 2024-05-25T16:11:47+00:00

Last Scan

Scanned2024-04-25T16:11:47+00:00
URL https://nordast.ru/robots.txt
Domain IPs 104.21.74.3, 172.67.194.55, 2606:4700:3034::ac43:c237, 2606:4700:3036::6815:4a03
Response IP 104.21.74.3
Found Yes
Hash 67b5acbaf52c35e2fd5a10ce5d3ff217c89a9732dd6c4eaea100afc2e6aed26f
SimHash 05881041d388

Groups

*

Rule Path
Disallow */index.php
Disallow /bitrix/
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*ORDER_BY
Disallow /*PAGEN
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*print_course%3D
Disallow /*?action=
Disallow /*%26action%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /*?utm_source=
Disallow /*?bxajaxid=
Disallow /*%26bxajaxid%3D
Disallow /*?view_result=
Disallow /*%26view_result%3D
Allow /bitrix/components/
Allow /bitrix/cache/
Allow /bitrix/js/
Allow /bitrix/templates/
Allow /bitrix/panel/

*

Product Comment
* правила для всеÑ
Rule Path Comment
Disallow /cgi-bin папка на Ñ
Disallow /bitrix/ папка с системными файлами битрикса
Disallow *bitrix_*%3D GET-запросы битрикса
Disallow /local/ папка с системными файлами битрикса
Disallow /*index.php$ дубли страниц index.php
Disallow /auth/ авторизация
Disallow *auth%3D авторизация
Disallow /personal/ личный кабинет
Disallow *register%3D регистрация
Disallow *forgot_password%3D забыли пароль
Disallow *change_password%3D изменить пароль
Disallow *login%3D логин
Disallow *logout%3D выÑ
Disallow */search/ поиск
Disallow *action%3D действия
Disallow *print%3D печать
Disallow *?new=Y новая страница
Disallow *?edit= редактирование
Disallow *?preview= предпросмотр
Disallow *backurl%3D трекбеки
Disallow *back_url%3D трекбеки
Disallow *back_url_admin%3D трекбеки
Disallow *captcha каптча
Disallow */feed все фиды
Disallow */rss rss фид
Disallow *?FILTER*= здесь и ниже различные популярные параметры фильтров
Disallow *?ei= -
Disallow *?p= -
Disallow *?q= -
Disallow *?tags= -
Disallow *B_ORDER%3D -
Disallow *BRAND%3D -
Disallow *CLEAR_CACHE%3D -
Disallow *ELEMENT_ID%3D -
Disallow *price_from%3D -
Disallow *price_to%3D -
Disallow *PROPERTY_TYPE%3D -
Disallow *PROPERTY_WIDTH%3D -
Disallow *PROPERTY_HEIGHT%3D -
Disallow *PROPERTY_DIA%3D -
Disallow *PROPERTY_OPENING_COUNT%3D -
Disallow *PROPERTY_SELL_TYPE%3D -
Disallow *PROPERTY_MAIN_TYPE%3D -
Disallow *PROPERTY_PRICE%5B*%5D%3D -
Disallow *S_LAST%3D -
Disallow *SECTION_ID%3D -
Disallow *SECTION%5B*%5D%3D -
Disallow *SHOWALL%3D -
Disallow *SHOW_ALL%3D -
Disallow *SHOWBY%3D -
Disallow *SORT%3D -
Disallow *SPHRASE_ID%3D -
Disallow *TYPE%3D -
Disallow *utm*%3D ссылки с utm-метками
Disallow *openstat%3D ссылки с метками openstat
Disallow *from%3D ссылки с метками from
Allow */upload/ открываем папку с файлами uploads
Allow /bitrix/*.js здесь и далее открываем для индексации скрипты
Allow /bitrix/*.css -
Allow /local/*.js -
Allow /local/*.css -
Allow /local/*.jpg -
Allow /local/*.jpeg -
Allow /local/*.png -
Allow /local/*.gif -

Warnings

  • 3 invalid lines.
  • `host` is not a known field.