Log In Sign Up

peredvizhnik.ru
robots.txt

Robots Exclusion Standard data for peredvizhnik.ru

Resource Scan

Scan Details

Site Domain peredvizhnik.ru
Base Domain peredvizhnik.ru
Scan Status Ok
Last Scan2024-10-22T21:22:12+00:00
Next Scan 2024-11-21T21:22:12+00:00

Last Scan

Scanned2024-10-22T21:22:12+00:00
URL https://peredvizhnik.ru/robots.txt
Redirect https://www.peredvizhnik.ru/robots.txt
Redirect Domain www.peredvizhnik.ru
Redirect Base peredvizhnik.ru
Domain IPs 95.213.231.11
Redirect IPs 95.213.231.11
Response IP 95.213.231.11
Found Yes
Hash ba50e7126a90f05fe9955213c3de5b8dcf1299745dbdd83f46e0fee8a2be5f02
SimHash 54589845cb8d

Groups

*

Rule Path
Allow *.css
Allow *.js
Allow *.jpg
Allow *.webp
Allow *.jpeg
Allow *.png
Allow *.gif
Allow *.svg
Allow *.pdf
Allow /bitrix/js/
Allow /bitrix/templates/
Allow /bitrix/tools/conversion/ajax_counter.php
Allow /bitrix/components/main/
Allow /bitrix/css/
Disallow /bitrix/
Disallow /search/
Disallow /learning/
Disallow /catalog/_UNSORTED/
Disallow */_unsorted/*
Disallow /catalog/not_in_matrix/
Disallow /_admin/
Disallow /_tools/
Disallow /ajax/
Disallow /personal/
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*ORDER
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*print_course%3D
Disallow /*?action=
Disallow /*%26action%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /catalog/?q=
Disallow /quick_index/
Disallow /*?sphrase_id=
Disallow /*?roistat=
Disallow *utm*
Disallow *?SID=*
Disallow *?PAGEN=ALL*
Disallow *?range=*
Disallow *?etext=*
Disallow */compare/*
Disallow */favorites/*
Disallow *?store=*
Disallow *?filter*
Disallow *?recom*
Disallow *filter%5B%5D*

Other Records

Field Value
crawl-delay 200

yandex

Rule Path
Allow *.css
Allow *.js
Allow *.jpg
Allow *.webp
Allow *.jpeg
Allow *.png
Allow *.gif
Allow *.svg
Allow *.pdf
Allow /bitrix/js/
Allow /bitrix/templates/
Allow /bitrix/tools/conversion/ajax_counter.php
Allow /bitrix/components/main/
Allow /bitrix/css/
Disallow /bitrix/
Disallow /learning/
Disallow /search/
Disallow /catalog/_UNSORTED/
Disallow */_unsorted/*
Disallow /catalog/not_in_matrix/
Disallow /_admin/
Disallow /_tools/
Disallow /ajax/
Disallow /personal/
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*ORDER
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*print_course%3D
Disallow /*?action=
Disallow /*%26action%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /catalog/?q=
Disallow /quick_index/
Disallow /*?sphrase_id=
Disallow /*?roistat=
Disallow *?SID=*
Disallow *?PAGEN=ALL*
Disallow *?range=*
Disallow *?etext=*
Disallow */compare/*
Disallow */favorites/*
Disallow *?store=*
Disallow *?filter*
Disallow *?recom*
Disallow *filter%5B%5D*

googlebot

Rule Path
Allow *.css
Allow *.js
Allow *.jpg
Allow *.webp
Allow *.jpeg
Allow *.png
Allow *.gif
Allow *.svg
Allow *.pdf
Allow /bitrix/js/
Allow /bitrix/templates/
Allow /bitrix/tools/conversion/ajax_counter.php
Allow /bitrix/components/main/
Allow /bitrix/css/
Disallow /bitrix/
Disallow /learning/
Disallow /search/
Disallow /catalog/_UNSORTED/
Disallow */_unsorted/*
Disallow /catalog/not_in_matrix/
Disallow /_admin/
Disallow /_tools/
Disallow /ajax/
Disallow /personal/
Disallow /*show_include_exec_time%3D
Disallow /*show_page_exec_time%3D
Disallow /*show_sql_stat%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache%3D
Disallow /*clear_cache_session%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*ORDER
Disallow /*?print=
Disallow /*%26print%3D
Disallow /*print_course%3D
Disallow /*?action=
Disallow /*%26action%3D
Disallow /*register%3D
Disallow /*forgot_password%3D
Disallow /*change_password%3D
Disallow /*login%3D
Disallow /*logout%3D
Disallow /*auth%3D
Disallow /*backurl%3D
Disallow /*back_url%3D
Disallow /*BACKURL%3D
Disallow /*BACK_URL%3D
Disallow /*back_url_admin%3D
Disallow /catalog/?q=
Disallow /quick_index/
Disallow /*?sphrase_id=
Disallow /*?roistat=
Disallow *?SID=*
Disallow *?PAGEN=ALL*
Disallow *?range=*
Disallow *?etext=*
Disallow */compare/*
Disallow */favorites/*
Disallow *?store=*
Disallow *?filter*
Disallow *?recom*
Disallow *filter%5B%5D*

Other Records

Field Value
crawl-delay 20

anthropic-ai

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2000

claude

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2000

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2000

claude-web

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2000

amazonbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2000

geedoproductsearch

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2000
Back to top

Other Records

Field Value
sitemap https://www.peredvizhnik.ru/sitemap.xml
Back to top

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.
Back to top