dikoed.ru
robots.txt
Robots Exclusion Standard data for dikoed.ru
Resource Scan
Scan Details
| Site Domain | dikoed.ru |
| Base Domain | dikoed.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-06-11T19:31:56+00:00 |
| Next Scan | 2024-06-25T19:31:56+00:00 |
Last Successful Scan
| Scanned | 2024-05-04T19:31:10+00:00 |
| URL | https://dikoed.ru/robots.txt |
| Domain IPs | 89.108.116.106 |
| Response IP | 89.108.116.106 |
| Found | Yes |
| Hash | 2aad101015b6e26d253957625173071c9953e0fa6a16d81a68b1c51bff2c4b84 |
| SimHash | 6345bc6222ee |
Groups
*
| Rule | Path |
|---|---|
| Allow | */?items=opt |
| Allow | /*recipes* |
| Allow | /*types_cooking* |
| Allow | /upload/ |
| Allow | *PAGEN* |
| Disallow | */turbo/ |
| Disallow | */amp/ |
| Disallow | /about/ostavte-otzyv/ |
| Disallow | /catalog/*/ftr/*/*/*/*/*/* |
| Disallow | /recipes/ftr/*/*/*/*/* |
| Disallow | /recipes/*/?* |
| Disallow | /catalog/*/ftr/carcass_parts* |
| Disallow | /recipes/*carcass_parts* |
| Disallow | /*types_cooking*/*/*?* |
| Disallow | */?schemecutting* |
| Disallow | *? |
| Disallow | *%2C |
| Disallow | /*% |
| Disallow | /*.aspx |
| Disallow | /*.cfm |
| Disallow | /*.html |
| Disallow | */amp/ |
| Disallow | /*.php |
| Disallow | */_tools/ |
| Disallow | */include/ |
| Disallow | */testing/ |
| Disallow | */personal/ |
| Disallow | *javscript* |
| Disallow | */bitrix/ |
| Disallow | */auth/ |
| Disallow | */search/ |
| Disallow | /*/search/ |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*register%3D |
| Disallow | /*forgot_password%3D |
| Disallow | /*change_password%3D |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*auth%3D |
| Disallow | /*?action= |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*bitrix_ |
| Disallow | /*backurl%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*print_course%3DY |
| Disallow | /*COURSE_ID%3D |
| Disallow | /*?COURSE_ID= |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*SHOWALL |
| Disallow | */?epik=* |
| Disallow | */?SMART_FILTER_PATH=* |
| Disallow | /dealers-new |
| Disallow | /feedback |
| Disallow | /*show_all%3D |
| Disallow | *gclid* |
| Disallow | *yclid* |
| Disallow | *ysclid* |
| Disallow | *ymclid* |
| Disallow | *openstat* |
| Disallow | *frommarket* |
| Disallow | *utm_* |
| Disallow | *sort* |
| Disallow | *set_filter* |
| Disallow | *email* |
| Disallow | *bx_sender_conversion_id* |
| Disallow | *user* |
| Disallow | *USER_ID* |
| Disallow | *lang* |
| Disallow | *action* |
| Disallow | *print* |
| Disallow | *method%3Dasc* |
yandex
| Rule | Path |
|---|---|
| Allow | */?items=opt |
| Allow | /*recipes* |
| Allow | /*types_cooking* |
| Allow | /upload/ |
| Allow | *PAGEN* |
| Disallow | */amp/ |
| Disallow | /about/ostavte-otzyv/ |
| Disallow | /catalog/*/ftr/*/*/*/*/*/* |
| Disallow | /recipes/ftr/*/*/*/*/* |
| Disallow | /recipes/*/?* |
| Disallow | /catalog/*/ftr/carcass_parts* |
| Disallow | /recipes/*carcass_parts* |
| Disallow | /*types_cooking*/*/*?* |
| Disallow | */?schemecutting* |
| Disallow | *? |
| Disallow | *%2C |
| Disallow | /*% |
| Disallow | /*.aspx |
| Disallow | /*.cfm |
| Disallow | /*.html |
| Disallow | */amp/ |
| Disallow | /*.php |
| Disallow | */_tools/ |
| Disallow | */include/ |
| Disallow | */testing/ |
| Disallow | */personal/ |
| Disallow | *javscript* |
| Disallow | */bitrix/ |
| Disallow | */auth/ |
| Disallow | */search/ |
| Disallow | /*/search/ |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D |
| Disallow | /*%26print%3D |
| Disallow | /*register%3D |
| Disallow | /*forgot_password%3D |
| Disallow | /*change_password%3D |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*auth%3D |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*bitrix_ |
| Disallow | /*backurl%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*print_course%3DY |
| Disallow | /*COURSE_ID%3D |
| Disallow | /*?COURSE_ID= |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*SHOWALL |
| Disallow | /dealers-new |
| Disallow | /feedback |
googlebot
| Rule | Path |
|---|---|
| Allow | */?items=opt |
| Allow | /*recipes* |
| Allow | /*types_cooking* |
| Allow | /upload/ |
| Allow | *PAGEN* |
| Allow | *bitrix/cache* |
| Allow | *bitrix/js* |
| Allow | *.js |
| Allow | *.css |
| Allow | *bitrix/components/yuriyant/tracking4ecommerce/assets* |
| Allow | *bitrix/js/main/core* |
| Allow | *bitrix/js/ui/dexie/dist* |
| Allow | *bitrix/js/main/polyfill/customevent* |
| Allow | *assets/bower_components/jquery/dist* |
| Allow | *assets/js* |
| Disallow | */turbo/ |
| Disallow | /about/ostavte-otzyv/ |
| Disallow | /catalog/*/ftr/*/*/*/*/*/* |
| Disallow | /recipes/ftr/*/*/*/*/* |
| Disallow | /recipes/*/?* |
| Disallow | /catalog/*/ftr/carcass_parts* |
| Disallow | /recipes/*carcass_parts* |
| Disallow | /*types_cooking*/*/*?* |
| Disallow | */?schemecutting* |
| Disallow | *? |
| Disallow | *%2C |
| Disallow | /*% |
| Disallow | /*.aspx |
| Disallow | /*.cfm |
| Disallow | /*.html |
| Disallow | /*.php |
| Disallow | */_tools/* |
| Disallow | */include/* |
| Disallow | */testing/* |
| Disallow | /*index.php |
| Disallow | */personal/* |
| Disallow | *javscript* |
| Disallow | /*index.php$ |
| Disallow | */bitrix/* |
| Disallow | */auth/* |
| Disallow | */search/* |
| Disallow | /*/search/ |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D |
| Disallow | /*?print= |
| Disallow | /*%26print%3D |
| Disallow | /*register%3D |
| Disallow | /*forgot_password%3D |
| Disallow | /*change_password%3D |
| Disallow | /*login%3D |
| Disallow | /*logout%3D |
| Disallow | /*auth%3D |
| Disallow | /*?action= |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*bitrix_ |
| Disallow | /*backurl%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*print_course%3DY |
| Disallow | /*COURSE_ID%3D |
| Disallow | /*?COURSE_ID= |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*SHOWALL |
| Disallow | */?epik= |
| Disallow | */?SMART_FILTER_PATH= |
| Disallow | /dealers-new |
| Disallow | /feedback |
| Disallow | /*show_all%3D |
| Disallow | *gclid* |
| Disallow | *yclid* |
| Disallow | *ysclid* |
| Disallow | *ymclid* |
| Disallow | *openstat* |
| Disallow | *frommarket* |
| Disallow | *utm_* |
| Disallow | *sort* |
| Disallow | *set_filter* |
| Disallow | *email* |
| Disallow | *bx_sender_conversion_id* |
| Disallow | *user* |
| Disallow | *USER_ID* |
| Disallow | *lang* |
| Disallow | *action* |
| Disallow | *print* |
| Disallow | *method%3Dasc* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://dikoed.ru/sitemap.xml |
| sitemap | https://dikoed.ru/sitemap.xml |
Warnings
- 8 invalid lines.
- `clean-param` is not a known field.
Comments