Log In Sign Up

expertology.ru
robots.txt

Robots Exclusion Standard data for expertology.ru

Resource Scan

Scan Details

Site Domain expertology.ru
Base Domain expertology.ru
Scan Status Ok
Last Scan2024-06-02T10:30:53+00:00
Next Scan 2024-06-09T10:30:53+00:00

Last Scan

Scanned2024-06-02T10:30:53+00:00
URL https://expertology.ru/robots.txt
Domain IPs 104.26.8.115, 104.26.9.115, 172.67.74.90, 2606:4700:20::681a:873, 2606:4700:20::681a:973, 2606:4700:20::ac43:4a5a
Response IP 172.67.74.90
Found Yes
Hash 97aee9a6ddf06c4b326c82b74ee929ecac385d1513ad2e16450979ab0bb916b7
SimHash 0589986211b2

Groups

*

Rule Path
Disallow */bitrix
Disallow */index.php
Disallow */?IBLOCK
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*print_course%3D
Disallow /*?action=
Disallow /*%26action%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /*?utm_source=
Disallow /*?bxajaxid=
Disallow /*?_sm_byp
Disallow /*?epik
Disallow /*?sa
Disallow /*?zarsrc
Disallow /*%26bxajaxid%3D
Disallow /old/
Disallow /auth/
Disallow /poisk/?*
Disallow /*?sort=*
Disallow /*login*
Disallow /*?order
Disallow /fpass
Disallow /*sphrase*
Disallow /*?type
Disallow /*?SECTION_ID
Disallow /*/?ELEMENT_ID
Disallow /*/personal
Disallow /*/search
Disallow /?gclid=*
Disallow /*action%3D
Disallow /*.bak
Disallow /forum.php
Disallow /*test.php
Disallow /*clear_cache
Disallow /*?_r
Disallow /*?f
Disallow /*?how
Disallow /*?q
Disallow /*?utm
Disallow /*?tags
Disallow /*template%3D
Disallow /*?_utm
Disallow /*?CODE
Disallow /*?commentId

yandex

Rule Path
Disallow */bitrix
Disallow */index.php
Disallow */?IBLOCK
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*print_course%3D
Disallow /*?action=
Disallow /*%26action%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /*?utm_source=
Disallow /*?bxajaxid=
Disallow /*%26bxajaxid%3D
Disallow /old/
Disallow /auth/
Disallow /poisk/?*
Disallow /*?sort=*
Disallow /*login*
Disallow /*?order
Disallow /fpass
Disallow /*sphrase*
Disallow /*?type
Disallow /*?SECTION_ID
Disallow /*/?ELEMENT_ID
Disallow /*/personal
Disallow /*/search
Disallow /?gclid=*
Disallow /*action%3D
Disallow /*.bak
Disallow /forum.php
Disallow /*test.php
Disallow /*clear_cache
Disallow /*?_r
Disallow /*?f
Disallow /*?how
Disallow /*?q
Disallow /*?utm
Disallow /*?tags
Disallow /*template%3D
Disallow /*?_utm
Disallow /*?CODE
Disallow /*?commentId
Disallow /*?_sm_byp
Disallow /*?epik
Disallow /*?sa
Disallow /*?zarsrc

Other Records

Field Value
crawl-delay 2
Back to top

Other Records

Field Value
sitemap https://expertology.ru/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top