asberg.ru
robots.txt
Robots Exclusion Standard data for asberg.ru
Resource Scan
Scan Details
| Site Domain | asberg.ru |
| Base Domain | asberg.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2025-05-08T08:33:14+00:00 |
| Next Scan | 2025-08-06T08:33:14+00:00 |
Last Successful Scan
| Scanned | 2024-03-22T08:28:27+00:00 |
| URL | https://asberg.ru/robots.txt |
| Domain IPs | 104.26.6.122, 104.26.7.122, 172.67.68.109, 2606:4700:20::681a:67a, 2606:4700:20::681a:77a, 2606:4700:20::ac43:446d |
| Response IP | 172.67.68.109 |
| Found | Yes |
| Hash | c2fd8f13b38cb4a83241042e0da2bd05acd26b319de1a93b8f6b6f7eea4363d2 |
| SimHash | 4b0d9d62cefa |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /include_areas/ |
| Disallow | /vypolnennye-proekty/ |
| Disallow | /shop/brend/ |
| Disallow | /shop/catalog_new/ |
| Disallow | /bitrix/ |
| Disallow | /upload/ |
| Disallow | /search/ |
| Disallow | /login/ |
| Disallow | /auth/ |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*mobile%3D* |
| Disallow | /*auth%3Dyes |
| Disallow | /*bitrix_*%3D |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /?sphrase_id=* |
| Disallow | /*?* |
| Disallow | /*/search/ |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D* |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*print_course%3DY |
| Disallow | /*index.php$ |
| Disallow | /*/?brend=* |
| Disallow | /?css_show=y |
| Disallow | /*/?css_show=y |
| Disallow | /shop/search/ |
| Disallow | /shop/products-on-sale/ |
| Disallow | /zadat-vopros/ |
| Disallow | /email-to-subscribers-07102020.html |
| Disallow | /email-to-subscribers.html |
| Disallow | /shop/products-on-action/ |
| Disallow | /proizvodstvo/proizvodstvo-ksh/ |
| Disallow | /shop/search_advanced/ |
| Disallow | /shop/personal/ |
| Disallow | /xj-86b5NZE/ |
| Disallow | /goaccess-asb.html |
| Allow | /upload/resize_cache/iblock/ |
| Allow | /?utm_medium=cpc&utm_source=google-feedSE |
| Allow | /*?utm* |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.css |
| Allow | /bitrix/*.png |
| Allow | /bitrix/*.gif |
| Allow | /bitrix/*.jpg |
| Allow | /bitrix/*.JPG |
| Allow | /bitrix/*.jpeg |
| Allow | /bitrix/components/ |
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/panel/ |
| Allow | /upload/*.png |
| Allow | /upload/*.jpg |
| Allow | /upload/*.JPG |
| Allow | /upload/*.jpeg |
| Allow | /upload/*.gif |
| Allow | /*?PAGEN* |
| Allow | /*?ajax |
| Allow | /bitrix/tools/captcha.php |
yandex
| Rule | Path |
|---|---|
| Disallow | /shop/brend/ |
| Disallow | /shop/catalog_new/ |
| Disallow | /bitrix/ |
| Disallow | /upload/ |
| Disallow | /search/ |
| Disallow | /login/ |
| Disallow | /auth/ |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*mobile%3D* |
| Disallow | /*auth%3Dyes |
| Disallow | /*bitrix_*%3D |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /?sphrase_id=* |
| Disallow | /*/search/ |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D* |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*print_course%3DY |
| Disallow | /*index.php$ |
| Disallow | /*/?brend=* |
| Disallow | /?css_show=y |
| Disallow | /*/?css_show=y |
| Disallow | /*utm_source%3D |
| Disallow | /shop/prochee/ |
| Disallow | /*?* |
| Disallow | /shop/search/ |
| Disallow | /shop/products-on-sale/ |
| Disallow | /shop/products-on-action/ |
| Disallow | /shop/search_advanced/ |
| Disallow | /shop/personal/ |
| Disallow | /xj-86b5NZE/ |
| Disallow | /goaccess-asb.html |
| Allow | /upload/resize_cache/iblock/ |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.css |
| Allow | /bitrix/*.png |
| Allow | /bitrix/*.gif |
| Allow | /bitrix/*.jpg |
| Allow | /bitrix/*.JPG |
| Allow | /bitrix/*.jpeg |
| Allow | /bitrix/components/ |
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/panel/ |
| Allow | /upload/*.png |
| Allow | /upload/*.jpg |
| Allow | /upload/*.JPG |
| Allow | /upload/*.jpeg |
| Allow | /upload/*.gif |
| Allow | /*?PAGEN* |
| Allow | /*?ajax |
googlebot
| Rule | Path |
|---|---|
| Disallow | /shop/brend/ |
| Disallow | /shop/catalog_new/ |
| Disallow | /search/ |
| Disallow | /login/ |
| Disallow | /auth/ |
| Disallow | /*register%3Dyes |
| Disallow | /*forgot_password%3Dyes |
| Disallow | /*change_password%3Dyes |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*mobile%3D* |
| Disallow | /*auth%3Dyes |
| Disallow | /*bitrix_*%3D |
| Disallow | /*backurl%3D* |
| Disallow | /*BACKURL%3D* |
| Disallow | /*back_url%3D* |
| Disallow | /*BACK_URL%3D* |
| Disallow | /*back_url_admin%3D* |
| Disallow | /?sphrase_id=* |
| Disallow | /*/search/ |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D* |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*login%3Dyes |
| Disallow | /*logout%3Dyes |
| Disallow | /*auth%3Dyes |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*print_course%3DY |
| Disallow | /*index.php$ |
| Disallow | /*/?brend=* |
| Disallow | /?css_show=y |
| Disallow | /*/?css_show=y |
| Disallow | /shop/prochee/ |
| Disallow | /*?* |
| Disallow | /shop/search/ |
| Disallow | /shop/products-on-sale/ |
| Disallow | /shop/products-on-action/ |
| Disallow | /shop/search_advanced/ |
| Disallow | /shop/personal/ |
| Disallow | /xj-86b5NZE/ |
| Disallow | /goaccess-asb.html |
| Disallow | /shop/izbrannye-tovary/ |
| Disallow | /shop/configurator/levit/ |
| Disallow | /o-kompanii/ |
| Disallow | /shop/configurator/zenit |
| Disallow | /shop/configurator/pure-stal/ |
| Disallow | /shop/configurator/axcent/ |
| Disallow | /shop/configurator/basic-55/ |
| Disallow | /shop/configurator/ |
| Disallow | /shop/configurator/dinastiya/ |
| Disallow | /shop/configurator/zenit/ |
| Disallow | /shop/configurator/abb-b/ |
| Disallow | /shop/configurator/schneider_electric-b/sky-moon/ |
| Disallow | /shop/configurator/schneider_electric-b/ |
| Disallow | /shop/configurator/schneider_electric-b/axcent/ |
| Disallow | /shop/configurator/sky-moon/ |
| Disallow | /shop/configurator/abb-b/sky-moon/ |
| Disallow | /shop/configurator/future/ |
| Disallow | /shop/configurator/carat/ |
| Disallow | /shop/configurator/future-axcent-carat-dinastiya/ |
| Disallow | /shop/configurator/sky/ |
| Allow | /?utm_medium=cpc&utm_source=google-feedSE |
| Allow | /*?utm* |
| Allow | /upload/resize_cache/iblock/ |
| Allow | /bitrix/*.js |
| Allow | /bitrix/*.css |
| Allow | /bitrix/*.png |
| Allow | /bitrix/*.gif |
| Allow | /bitrix/*.jpg |
| Allow | /bitrix/*.JPG |
| Allow | /bitrix/*.jpeg |
| Allow | /bitrix/components/ |
| Allow | /bitrix/cache/ |
| Allow | /bitrix/js/ |
| Allow | /bitrix/templates/ |
| Allow | /bitrix/panel/ |
| Allow | /upload/*.png |
| Allow | /upload/*.jpg |
| Allow | /upload/*.JPG |
| Allow | /upload/*.jpeg |
| Allow | /upload/*.gif |
| Allow | /*?PAGEN* |
| Allow | /*?ajax |
| Allow | /bitrix/tools/captcha.php |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.asberg.ru/sitemap.xml |
Warnings
- `host` is not a known field.
Comments