re-technics.ru
robots.txt

Robots Exclusion Standard data for re-technics.ru

Resource Scan

Scan Details

Site Domain re-technics.ru
Base Domain re-technics.ru
Scan Status Ok
Last Scan2024-09-15T09:24:49+00:00
Next Scan 2024-10-15T09:24:49+00:00

Last Scan

Scanned2024-09-15T09:24:49+00:00
URL https://re-technics.ru/robots.txt
Redirect https://www.re-technics.ru/robots.txt
Redirect Domain www.re-technics.ru
Redirect Base re-technics.ru
Domain IPs 2a00:f940:2:2:1:3:0:164, 31.31.198.213
Redirect IPs 2a00:f940:2:2:1:3:0:164, 31.31.198.213
Response IP 31.31.198.213
Found Yes
Hash f749d5c4cd27a02821150a39beb8cef93c24ce5225837b67a0163791e169f8ea
SimHash 44d99f1725b5

Groups

*

Rule Path
Allow /bitrix/catalog_export/
Allow /bitrix/components/
Allow /bitrix/cache/
Allow /bitrix/js/
Allow /bitrix/templates/
Allow /bitrix/panel/
Disallow */index.php
Disallow /bitrix/
Disallow /xml/
Disallow /test/
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*ORDER_BY
Disallow /*PAGEN
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*print_course%3D
Disallow /*?action=
Disallow /*%26action%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /*?utm_source=
Disallow /*?bxajaxid=
Disallow /*%26bxajaxid%3D
Disallow /*?view_result=
Disallow /*%26view_result%3D
Disallow /personal
Disallow /cart

Other Records

Field Value
crawl-delay 2

yandex

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexmedia

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandeximages

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexblogs

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexnews

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexmetrika

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

yandexmarket

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

googlebot

Rule Path
Disallow personal
Disallow cart

googlebot-news
googlebot-image
googlebot-video
googlebot-mobile

No rules defined. All paths allowed.

Other Records

Field Value
sitemap https://www.re-technics.ru/sitemap.xml
sitemap http://www.re-technics.ru/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.