rutector.ru
robots.txt

Robots Exclusion Standard data for rutector.ru

Resource Scan

Scan Details

Site Domain rutector.ru
Base Domain rutector.ru
Scan Status Ok
Last Scan2025-05-11T21:58:53+00:00
Next Scan 2025-06-10T21:58:53+00:00

Last Scan

Scanned2025-05-11T21:58:53+00:00
URL https://rutector.ru/robots.txt
Response IP 37.18.100.76
Found Yes
Hash 9756cdb67132bf220ffadfe0045c00d56f8b6e4027357af8284d0115386492f7
SimHash 091a50434683

Groups

*

Rule Path
Disallow */products/test-0001
Disallow */catalog/compare
Disallow */favorites
Allow */catalog/compare$
Allow */favorites$
Disallow *yadordid%3D*%26*
Allow *bitrix/*.xml
Disallow *?pagen_1=*&pagen_
Disallow *?pagen_2=*&pagen_
Disallow *?pagen_3=*&pagen_
Disallow *?PAGEN_*=*&PAGEN_
Disallow *?PAGEN_4=
Disallow *?PAGEN_1=
Disallow *?PAGEN_1=*&PAGEN_
Disallow *?PAGEN_2=*&PAGEN_
Disallow *?PAGEN_3=*&PAGEN_
Allow */press/*?PAGEN_3=
Disallow *arrFilter_
Disallow /bitrix/
Disallow *bitrix_*%3D
Disallow /local/
Disallow /*index.php$
Disallow /auth/
Disallow *auth%3D
Disallow /personal/
Disallow *register%3D
Disallow *forgot_password%3D
Disallow *change_password%3D
Disallow /login/
Disallow *login%3D
Disallow *logout%3D
Disallow */search/
Disallow *action%3D
Disallow *print%3D
Disallow *?new=Y
Disallow *?edit=
Disallow *?preview=
Disallow *backurl%3D
Disallow *back_url%3D
Disallow *back_url_admin%3D
Disallow *captcha
Disallow */feed
Disallow */rss
Disallow *?FILTER*=
Disallow /search
Disallow *category_id%3D
Disallow *product_id%3D
Disallow *?page=
Disallow *?ei=
Disallow *?p=
Disallow *?q=
Disallow *?tags=
Disallow *B_ORDER%3D
Disallow *BRAND%3D
Disallow *CLEAR_CACHE%3D
Disallow *ELEMENT_ID%3D
Disallow *price_from%3D
Disallow *price_to%3D
Disallow *PROPERTY_TYPE%3D
Disallow *PROPERTY_WIDTH%3D
Disallow *PROPERTY_HEIGHT%3D
Disallow *PROPERTY_DIA%3D
Disallow *PROPERTY_OPENING_COUNT%3D
Disallow *PROPERTY_SELL_TYPE%3D
Disallow *PROPERTY_MAIN_TYPE%3D
Disallow *PROPERTY_PRICE%5B*%5D%3D
Disallow *S_LAST%3D
Disallow *SECTION_ID%3D
Disallow *SECTION%5B*%5D%3D
Disallow *SHOWALL%3D
Disallow *SHOW_ALL%3D
Disallow *SHOWBY%3D
Disallow *SORT%3D
Disallow *SPHRASE_ID%3D
Disallow *TYPE%3D
Disallow /*sort%3D
Disallow */filter/
Disallow /*nav-*
Disallow /compare/
Disallow /webstat/
Disallow /desktop_app/
Disallow /ajax/
Disallow /test/
Disallow /stranica-podbora
Disallow /golosovanie-za-foto
Disallow /oplata
Disallow /lizingovye-kompanii
Disallow /opros-dilerov
Disallow /zapros-v-buhgalteriyu
Disallow /uznat-status-zakaza
Disallow /kak-kupit
Disallow /trebovaniya-k-transportnym-sredstvam
Disallow /otpiska-ot-rassylki
Disallow /zagruzka-kataloga
Disallow /thankyou
Disallow /usloviya-konfidencialnosti
Disallow /opros-pokupatelei
Disallow /vozvrat-i-obmen-tovara
Disallow /podpisatsya-na-rassylku
Disallow /whowhere/spasibo
Disallow /whowhere/spasibo-za-opros
Disallow /whowhere/spasibo-bez-pisma
Disallow /404.php
Disallow /whowhere/blagodarim-za-zapolnenie-formy
Allow /upload/medialibrary/
Allow /upload/resize_cache/main/
Allow /upload/resize_cache/iblock/
Allow /upload/resize_cache/medialibrary/
Allow /bitrix/components/
Allow /bitrix/templates/
Allow /bitrix/cache/
Allow /bitrix/css/
Allow /bitrix/js/
Allow /bitrix/images/
Allow /local/components/
Allow /local/templates/
Allow /local/*.js
Allow /local/*.css
Allow /local/*.jpg
Allow /local/*.jpeg
Allow /local/*.png
Allow /local/*.gif

yandex

Rule Path
Disallow */products/test-0001
Disallow */catalog/compare
Disallow */favorites
Allow */catalog/compare$
Allow */favorites$
Disallow *yadordid%3D*%26*
Allow *bitrix/*.xml
Disallow /upload/avito/
Disallow *?pagen_1=*&pagen_
Disallow *?pagen_2=*&pagen_
Disallow *?pagen_3=*&pagen_
Disallow *?PAGEN_*=*&PAGEN_
Disallow *?PAGEN_4=
Disallow *?PAGEN_1=
Disallow *?PAGEN_1=*&PAGEN_
Disallow *?PAGEN_2=*&PAGEN_
Disallow *?PAGEN_3=*&PAGEN_
Allow */press/*?PAGEN_3=
Disallow *arrFilter_
Disallow /bitrix/
Disallow *bitrix_*%3D
Disallow /local/
Disallow /*index.php$
Disallow /auth/
Disallow *auth%3D
Disallow /personal/
Disallow *register%3D
Disallow *forgot_password%3D
Disallow *change_password%3D
Disallow /login/
Disallow *login%3D
Disallow *logout%3D
Disallow */search/
Disallow *action%3D
Disallow *print%3D
Disallow *?new=Y
Disallow *?edit=
Disallow *?preview=
Disallow *backurl%3D
Disallow *back_url%3D
Disallow *back_url_admin%3D
Disallow *captcha
Disallow */feed
Disallow */rss
Disallow *?FILTER*=
Disallow /search
Disallow *category_id%3D
Disallow *product_id%3D
Disallow *?page=
Disallow *?ei=
Disallow *?p=
Disallow *?q=
Disallow *?tags=
Disallow *B_ORDER%3D
Disallow *BRAND%3D
Disallow *CLEAR_CACHE%3D
Disallow *ELEMENT_ID%3D
Disallow *price_from%3D
Disallow *price_to%3D
Disallow *PROPERTY_TYPE%3D
Disallow *PROPERTY_WIDTH%3D
Disallow *PROPERTY_HEIGHT%3D
Disallow *PROPERTY_DIA%3D
Disallow *PROPERTY_OPENING_COUNT%3D
Disallow *PROPERTY_SELL_TYPE%3D
Disallow *PROPERTY_MAIN_TYPE%3D
Disallow *PROPERTY_PRICE%5B*%5D%3D
Disallow *S_LAST%3D
Disallow *SECTION_ID%3D
Disallow *SECTION%5B*%5D%3D
Disallow *SHOWALL%3D
Disallow *SHOW_ALL%3D
Disallow *SHOWBY%3D
Disallow *SPHRASE_ID%3D
Disallow *TYPE%3D
Disallow */filter/
Disallow /*nav-*
Disallow /compare/
Disallow /webstat/
Disallow /desktop_app/
Disallow /ajax/
Disallow /test/
Disallow /stranica-podbora
Disallow /golosovanie-za-foto
Disallow /oplata
Disallow /lizingovye-kompanii
Disallow /opros-dilerov
Disallow /zapros-v-buhgalteriyu
Disallow /uznat-status-zakaza
Disallow /kak-kupit
Disallow /trebovaniya-k-transportnym-sredstvam
Disallow /otpiska-ot-rassylki
Disallow /zagruzka-kataloga
Disallow /thankyou
Disallow /usloviya-konfidencialnosti
Disallow /opros-pokupatelei
Disallow /vozvrat-i-obmen-tovara
Disallow /podpisatsya-na-rassylku
Disallow /whowhere/spasibo
Disallow /whowhere/spasibo-za-opros
Disallow /whowhere/spasibo-bez-pisma
Disallow /404.php
Disallow /whowhere/blagodarim-za-zapolnenie-formy
Allow /upload/medialibrary/
Allow /upload/resize_cache/main/
Allow /upload/resize_cache/iblock/
Allow /upload/resize_cache/medialibrary/
Allow /bitrix/components/
Allow /bitrix/templates/
Allow /bitrix/cache/
Allow /bitrix/css/
Allow /bitrix/js/
Allow /bitrix/images/
Allow /local/components/
Allow /local/templates/
Allow /local/*.js
Allow /local/*.css
Allow /local/*.jpg
Allow /local/*.jpeg
Allow /local/*.png
Allow /local/*.gif

googlebot

Rule Path
Disallow */products/test-0001
Disallow */catalog/compare
Disallow */favorites
Allow */catalog/compare$
Allow */favorites$
Disallow /upload/avito/
Disallow *yadordid%3D*%26*
Disallow *?pagen_1=*&pagen_
Disallow *?pagen_2=*&pagen_
Disallow *?pagen_3=*&pagen_
Disallow *?PAGEN_*=*&PAGEN_
Disallow *?PAGEN_4=
Disallow *?PAGEN_1=
Disallow *?PAGEN_1=*&PAGEN_
Disallow *?PAGEN_2=*&PAGEN_
Disallow *?PAGEN_3=*&PAGEN_
Allow */press/*?PAGEN_3=
Disallow *arrFilter_
Disallow /bitrix/
Disallow *bitrix_*%3D
Disallow /local/
Disallow /*index.php$
Disallow /auth/
Disallow *auth%3D
Disallow /personal/
Disallow *register%3D
Disallow *forgot_password%3D
Disallow *change_password%3D
Disallow /login/
Disallow *login%3D
Disallow *logout%3D
Disallow */search/
Disallow *action%3D
Disallow *print%3D
Disallow *?new=Y
Disallow *?edit=
Disallow *?preview=
Disallow *backurl%3D
Disallow *back_url%3D
Disallow *back_url_admin%3D
Disallow *captcha
Disallow */feed
Disallow */rss
Disallow *?FILTER*=
Disallow /search
Disallow *category_id%3D
Disallow *product_id%3D
Disallow *?page=
Disallow *?ei=
Disallow *?p=
Disallow *?q=
Disallow *?tags=
Disallow *B_ORDER%3D
Disallow *BRAND%3D
Disallow *CLEAR_CACHE%3D
Disallow *ELEMENT_ID%3D
Disallow *price_from%3D
Disallow *price_to%3D
Disallow *PROPERTY_TYPE%3D
Disallow *PROPERTY_WIDTH%3D
Disallow *PROPERTY_HEIGHT%3D
Disallow *PROPERTY_DIA%3D
Disallow *PROPERTY_OPENING_COUNT%3D
Disallow *PROPERTY_SELL_TYPE%3D
Disallow *PROPERTY_MAIN_TYPE%3D
Disallow *PROPERTY_PRICE%5B*%5D%3D
Disallow *S_LAST%3D
Disallow *SECTION_ID%3D
Disallow *SECTION%5B*%5D%3D
Disallow *SHOWALL%3D
Disallow *SHOW_ALL%3D
Disallow *SHOWBY%3D
Disallow *SORT%3D
Disallow *SPHRASE_ID%3D
Disallow *TYPE%3D
Disallow /*sort%3D
Disallow */filter/
Disallow /*nav-*
Disallow /compare/
Disallow /webstat/
Disallow /desktop_app/
Disallow /ajax/
Disallow /test/
Disallow /stranica-podbora
Disallow /golosovanie-za-foto
Disallow /oplata
Disallow /lizingovye-kompanii
Disallow /opros-dilerov
Disallow /zapros-v-buhgalteriyu
Disallow /uznat-status-zakaza
Disallow /kak-kupit
Disallow /trebovaniya-k-transportnym-sredstvam
Disallow /otpiska-ot-rassylki
Disallow /zagruzka-kataloga
Disallow /thankyou
Disallow /usloviya-konfidencialnosti
Disallow /opros-pokupatelei
Disallow /vozvrat-i-obmen-tovara
Disallow /podpisatsya-na-rassylku
Disallow /whowhere/spasibo
Disallow /whowhere/spasibo-za-opros
Disallow /whowhere/spasibo-bez-pisma
Disallow /404.php
Disallow /whowhere/blagodarim-za-zapolnenie-formy
Allow /upload/medialibrary/
Allow /upload/resize_cache/main/
Allow /upload/resize_cache/iblock/
Allow /upload/resize_cache/medialibrary/
Allow /bitrix/components/
Allow /bitrix/templates/
Allow /bitrix/cache/
Allow /bitrix/css/
Allow /bitrix/js/
Allow /bitrix/images/
Allow /local/components/
Allow /local/templates/
Allow /local/*.js
Allow /local/*.css
Allow /local/*.jpg
Allow /local/*.jpeg
Allow /local/*.png
Allow /local/*.gif

ahrefsbot

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

megaindex

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

riddler (http://riddler.io/about)

Rule Path
Disallow /

python-urllib/2.6

Rule Path
Disallow /

disco pump

Rule Path
Disallow /

wget

Rule Path
Disallow /

teleport pro

Rule Path
Disallow /

psbot

Rule Path
Disallow /

twiceler

Rule Path
Disallow /

netinfobot

Rule Path
Disallow /

ubicrawler

Rule Path
Disallow /

doc

Rule Path
Disallow /

zao

Rule Path
Disallow /

sitecheck.internetseer.com

Rule Path
Disallow /

zealbot

Rule Path
Disallow /

msiecrawler

Rule Path
Disallow /

sitesnagger

Rule Path
Disallow /

webstripper

Rule Path
Disallow /

webcopier

Rule Path
Disallow /

fetch

Rule Path
Disallow /

offline explorer

Rule Path
Disallow /

teleport

Rule Path
Disallow /

linko

Rule Path
Disallow /

httrack

Rule Path
Disallow /

microsoft.url.control

Rule Path
Disallow /

xenu

Rule Path
Disallow /

larbin

Rule Path
Disallow /

libwww

Rule Path
Disallow /

zyborg

Rule Path
Disallow /

download ninja

Rule Path
Disallow /

grub-client

Rule Path
Disallow /

npbot

Rule Path
Disallow /

webreaper

Rule Path
Disallow /

Other Records

Field Value
sitemap https://rutector.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.