профлаб.рф
robots.txt
Robots Exclusion Standard data for профлаб.рф
Resource Scan
Scan Details
Site Domain | профлаб.рф |
Base Domain | профлаб.рф |
Scan Status | Ok |
Last Scan | 2024-09-24T05:17:55+00:00 |
Next Scan | 2024-10-24T05:17:55+00:00 |
Last Scan
Scanned | 2024-09-24T05:17:55+00:00 |
URL | https://профлаб.рф/robots.txt |
Redirect | https://xn--80ac2aleg3a.xn--p1ai/robots.txt |
Domain IPs | 87.236.16.91 |
Response IP | 87.236.16.91 |
Found | Yes |
Hash | df4f4500b701cb147a1397420a61a3d1d933c82063b3e5e5ec40728d34f1a334 |
SimHash | 1514c0d4d521 |
Groups
*
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 1 |
yandex
googlebot
Rule | Path |
---|---|
Allow | *.css |
Allow | *.jpeg |
Allow | *.jpg |
Allow | *.js |
Allow | |
Allow | *.png |
Allow | *.webp |
Allow | */upload/ |
Allow | */upload/*.css |
Allow | */upload/*.jpeg |
Allow | */upload/*.jpg |
Allow | */upload/*.js |
Allow | */upload/*.pdf |
Allow | */upload/*.png |
Allow | */upload/*.webp |
Allow | /bitrix/*.css |
Allow | /bitrix/*.js |
Allow | /bitrix/cache/ |
Allow | /bitrix/components/ |
Allow | /bitrix/css/ |
Allow | /bitrix/js/ |
Allow | /bitrix/panel/ |
Allow | /bitrix/templates/ |
Allow | /local/*.css |
Allow | /local/*.gif |
Allow | /local/*.jpeg |
Allow | /local/*.jpg |
Allow | /local/*.js |
Allow | /local/*.png |
Allow | /yandex-turbo/ |
Disallow | *?edit= |
Disallow | *?ei= |
Disallow | *?FILTER*= |
Disallow | *?new=Y |
Disallow | *?p= |
Disallow | *?preview= |
Disallow | *?q= |
Disallow | *?tags= |
Disallow | *?type=* |
Disallow | */.well-known/apple-app-site-association/ |
Disallow | */ads.txt |
Disallow | */catalog2/* |
Disallow | */feed |
Disallow | */filter/* |
Disallow | */index.php |
Disallow | */page/ |
Disallow | */rss |
Disallow | */search/ |
Disallow | */upload/* |
Disallow | *action%3D |
Disallow | *action%3D* |
Disallow | *arrFilter_cf* |
Disallow | *arrFilter* |
Disallow | *auth%3D |
Disallow | *back_url_admin%3D |
Disallow | *back_url%3D |
Disallow | *backurl%3D |
Disallow | *bitrix_*%3D |
Disallow | *BRAND%3D |
Disallow | *captcha |
Disallow | *change_password%3D |
Disallow | *CONVERT_CURRENCY%3D* |
Disallow | *del_filter* |
Disallow | *ELEMENT_ID%3D |
Disallow | *forgot_password%3D |
Disallow | *from%3D |
Disallow | *gclid%3D |
Disallow | *login%3D |
Disallow | *logout%3D |
Disallow | *openstat%3D |
Disallow | *price_from%3D |
Disallow | *price_to%3D |
Disallow | *print%3D |
Disallow | *register%3D |
Disallow | *S_LAST%3D |
Disallow | *SECTION_ID%3D |
Disallow | *SECTION%5B*%5D%3D |
Disallow | *set_filter_ajax* |
Disallow | *set_filter%3D* |
Disallow | *SHOW_ALL* |
Disallow | *SHOW_ALL%3D |
Disallow | *SHOWALL%3D |
Disallow | *SHOWBY%3D |
Disallow | *TYPE%3D |
Disallow | *utm_ |
Disallow | *yclid%3D |
Disallow | /?action_cpv= |
Disallow | /?action= |
Disallow | /?brand= |
Disallow | /?detail.php%3F |
Disallow | /?sort= |
Disallow | /?utm_source= |
Disallow | /?view= |
Disallow | /*? |
Disallow | /*?* |
Disallow | /*?action= |
Disallow | /*?print= |
Disallow | /*/search/ |
Disallow | /*/slide_show/ |
Disallow | /*%26 |
Disallow | /*%26action%3D |
Disallow | /*%26print%3D |
Disallow | /*%3D |
Disallow | /*ADD_TO_COMPARE_LIST |
Disallow | /*back_url_admin%3D |
Disallow | /*back_url%3D |
Disallow | /*backurl%3D |
Disallow | /*bitrix_include_areas%3D |
Disallow | /*clear_cache_session%3D |
Disallow | /*clear_cache%3D |
Disallow | /*index.php$ |
Disallow | /*ORDER_BY |
Disallow | /*page%3D |
Disallow | /*print_course%3D |
Disallow | /*utm* |
Disallow | /apply/ |
Disallow | /auth/ |
Disallow | /bitrix/ |
Disallow | /bitrix/redirect.php |
Disallow | /cgi-bin |
Disallow | /clear/ |
Disallow | /cron/*.php |
Disallow | /dev/ |
Disallow | /filter/ |
Disallow | /form/ |
Disallow | /forum/ |
Disallow | /local/ |
Disallow | /order/ |
Disallow | /page%3D |
Disallow | /personal/ |
Disallow | /product/ |
Disallow | /search/ |
Disallow | /test-catalog/ |
Other Records
Field | Value |
---|---|
sitemap | https://xn--80ac2aleg3a.xn--p1ai/sitemap.xml |
sitemap | https://xn--80ac2aleg3a.xn--p1ai/sitemap.xml |
sitemap | https://xn--80ac2aleg3a.xn--p1ai/sitemap-iblock-8.xml |
sitemap | https://xn--80ac2aleg3a.xn--p1ai/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.