профлаб.рф
robots.txt

Robots Exclusion Standard data for профлаб.рф

Resource Scan

Scan Details

Site Domain профлаб.рф
Base Domain профлаб.рф
Scan Status Ok
Last Scan2024-09-24T05:17:55+00:00
Next Scan 2024-10-24T05:17:55+00:00

Last Scan

Scanned2024-09-24T05:17:55+00:00
URL https://профлаб.рф/robots.txt
Redirect https://xn--80ac2aleg3a.xn--p1ai/robots.txt
Domain IPs 87.236.16.91
Response IP 87.236.16.91
Found Yes
Hash df4f4500b701cb147a1397420a61a3d1d933c82063b3e5e5ec40728d34f1a334
SimHash 1514c0d4d521

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 1

yandex
googlebot

Rule Path
Allow *.css
Allow *.jpeg
Allow *.jpg
Allow *.js
Allow *.pdf
Allow *.png
Allow *.webp
Allow */upload/
Allow */upload/*.css
Allow */upload/*.jpeg
Allow */upload/*.jpg
Allow */upload/*.js
Allow */upload/*.pdf
Allow */upload/*.png
Allow */upload/*.webp
Allow /bitrix/*.css
Allow /bitrix/*.js
Allow /bitrix/cache/
Allow /bitrix/components/
Allow /bitrix/css/
Allow /bitrix/js/
Allow /bitrix/panel/
Allow /bitrix/templates/
Allow /local/*.css
Allow /local/*.gif
Allow /local/*.jpeg
Allow /local/*.jpg
Allow /local/*.js
Allow /local/*.png
Allow /yandex-turbo/
Disallow *?edit=
Disallow *?ei=
Disallow *?FILTER*=
Disallow *?new=Y
Disallow *?p=
Disallow *?preview=
Disallow *?q=
Disallow *?tags=
Disallow *?type=*
Disallow */.well-known/apple-app-site-association/
Disallow */ads.txt
Disallow */catalog2/*
Disallow */feed
Disallow */filter/*
Disallow */index.php
Disallow */page/
Disallow */rss
Disallow */search/
Disallow */upload/*
Disallow *action%3D
Disallow *action%3D*
Disallow *arrFilter_cf*
Disallow *arrFilter*
Disallow *auth%3D
Disallow *back_url_admin%3D
Disallow *back_url%3D
Disallow *backurl%3D
Disallow *bitrix_*%3D
Disallow *BRAND%3D
Disallow *captcha
Disallow *change_password%3D
Disallow *CONVERT_CURRENCY%3D*
Disallow *del_filter*
Disallow *ELEMENT_ID%3D
Disallow *forgot_password%3D
Disallow *from%3D
Disallow *gclid%3D
Disallow *login%3D
Disallow *logout%3D
Disallow *openstat%3D
Disallow *price_from%3D
Disallow *price_to%3D
Disallow *print%3D
Disallow *register%3D
Disallow *S_LAST%3D
Disallow *SECTION_ID%3D
Disallow *SECTION%5B*%5D%3D
Disallow *set_filter_ajax*
Disallow *set_filter%3D*
Disallow *SHOW_ALL*
Disallow *SHOW_ALL%3D
Disallow *SHOWALL%3D
Disallow *SHOWBY%3D
Disallow *TYPE%3D
Disallow *utm_
Disallow *yclid%3D
Disallow /?action_cpv=
Disallow /?action=
Disallow /?brand=
Disallow /?detail.php%3F
Disallow /?sort=
Disallow /?utm_source=
Disallow /?view=
Disallow /*?
Disallow /*?*
Disallow /*?action=
Disallow /*?print=
Disallow /*/search/
Disallow /*/slide_show/
Disallow /*%26
Disallow /*%26action%3D
Disallow /*%26print%3D
Disallow /*%3D
Disallow /*ADD_TO_COMPARE_LIST
Disallow /*back_url_admin%3D
Disallow /*back_url%3D
Disallow /*backurl%3D
Disallow /*bitrix_include_areas%3D
Disallow /*clear_cache_session%3D
Disallow /*clear_cache%3D
Disallow /*index.php$
Disallow /*ORDER_BY
Disallow /*page%3D
Disallow /*print_course%3D
Disallow /*utm*
Disallow /apply/
Disallow /auth/
Disallow /bitrix/
Disallow /bitrix/redirect.php
Disallow /cgi-bin
Disallow /clear/
Disallow /cron/*.php
Disallow /dev/
Disallow /filter/
Disallow /form/
Disallow /forum/
Disallow /local/
Disallow /order/
Disallow /page%3D
Disallow /personal/
Disallow /product/
Disallow /search/
Disallow /test-catalog/

Other Records

Field Value
sitemap https://xn--80ac2aleg3a.xn--p1ai/sitemap.xml
sitemap https://xn--80ac2aleg3a.xn--p1ai/sitemap.xml
sitemap https://xn--80ac2aleg3a.xn--p1ai/sitemap-iblock-8.xml
sitemap https://xn--80ac2aleg3a.xn--p1ai/sitemap.xml

Warnings

  • `clean-param` is not a known field.
  • `host` is not a known field.