vsesorta.ru
robots.txt
Robots Exclusion Standard data for vsesorta.ru
Resource Scan
Scan Details
| Site Domain | vsesorta.ru |
| Base Domain | vsesorta.ru |
| Scan Status | Failed |
| Failure Stage | Fetching resource. |
| Failure Reason | Server returned a client error. |
| Last Scan | 2024-10-04T01:35:53+00:00 |
| Next Scan | 2025-01-02T01:35:53+00:00 |
Last Successful Scan
| Scanned | 2024-05-31T00:39:57+00:00 |
| URL | https://vsesorta.ru/robots.txt |
| Domain IPs | 89.108.110.168 |
| Response IP | 89.108.110.168 |
| Found | Yes |
| Hash | 417d6b55f2e18c9087c80347f996459143d02733eaa400068985866e4db94cbc |
| SimHash | 6305bd622aee |
Groups
*
| Rule | Path |
|---|---|
| Allow | /upload/ |
| Allow | *PAGEN* |
| Disallow | /catalog/plants/*/*/*/*/*/*/* |
| Disallow | */amp/ |
| Disallow | */turbo/ |
| Disallow | *height_to_only_smart_filter-is* |
| Disallow | *? |
| Disallow | *%2C |
| Disallow | /*% |
| Disallow | /*.aspx |
| Disallow | /*.cfm |
| Disallow | /*.html |
| Disallow | */amp/ |
| Disallow | */admin/ |
| Disallow | /*.php |
| Disallow | */personal/ |
| Disallow | */cart/ |
| Disallow | *javscript |
| Disallow | */bitrix/ |
| Disallow | */tmp/ |
| Disallow | */auth/ |
| Disallow | */search/ |
| Disallow | /*/search/ |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D |
| Disallow | /*%26print%3D |
| Disallow | /*register%3D |
| Disallow | /*forgot_password%3D |
| Disallow | /*change_password%3D |
| Disallow | /*login |
| Disallow | /*logout |
| Disallow | /*auth |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*bitrix_ |
| Disallow | /*backurl%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*print_course%3DY |
| Disallow | /*COURSE_ID%3D |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | *SHOWALL |
| Disallow | *show_all%3D |
| Disallow | *tip_produkta |
| Disallow | */instructions/ |
| Disallow | */shtambovye-derevya_ |
| Disallow | */?bg= |
| Disallow | */?sa= |
| Disallow | *gclid* |
| Disallow | *yclid* |
| Disallow | *ysclid* |
| Disallow | *ymclid* |
| Disallow | *openstat* |
| Disallow | *frommarket* |
| Disallow | *utm_* |
| Disallow | *sort* |
| Disallow | *set_filter* |
| Disallow | *email* |
| Disallow | *bx_sender_conversion_id* |
| Disallow | *user* |
| Disallow | *USER_ID* |
| Disallow | *lang* |
| Disallow | *action* |
| Disallow | *print* |
| Disallow | *method%3Dasc* |
yandex
| Rule | Path |
|---|---|
| Allow | /upload/ |
| Allow | *PAGEN* |
| Disallow | /catalog/plants/*/*/*/*/*/*/* |
| Disallow | */amp/ |
| Disallow | *height_to_only_smart_filter-is* |
| Disallow | *? |
| Disallow | *%2C |
| Disallow | /*% |
| Disallow | /*.aspx |
| Disallow | /*.cfm |
| Disallow | /*.html |
| Disallow | */amp/ |
| Disallow | */admin/ |
| Disallow | /*.php |
| Disallow | */personal/ |
| Disallow | *javscript |
| Disallow | */cart/ |
| Disallow | */bitrix/ |
| Disallow | */auth/ |
| Disallow | */search/ |
| Disallow | /*/search/ |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D |
| Disallow | /*register%3D |
| Disallow | /*forgot_password%3D |
| Disallow | /*change_password%3D |
| Disallow | /*login |
| Disallow | /*logout |
| Disallow | /*auth |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*bitrix_ |
| Disallow | /*backurl%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*print_course%3DY |
| Disallow | /*COURSE_ID%3D |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | *SHOWALL |
| Disallow | *show_all%3D |
| Disallow | *tip_produkta |
| Disallow | */instructions/ |
| Disallow | */shtambovye-derevya_ |
googlebot
| Rule | Path |
|---|---|
| Allow | /upload/ |
| Allow | *PAGEN* |
| Allow | *bitrix/cache* |
| Allow | *bitrix/js* |
| Allow | *.js |
| Allow | *.css |
| Allow | *bitrix/components/yuriyant/tracking4ecommerce/assets* |
| Allow | *bitrix/js/main/core* |
| Allow | *bitrix/js/ui/dexie/dist* |
| Allow | *bitrix/js/main/polyfill/customevent* |
| Allow | *assets/bower_components/jquery/dist* |
| Allow | *assets/js* |
| Disallow | /catalog/plants/*/*/*/*/*/*/* |
| Disallow | */turbo/ |
| Disallow | *height_to_only_smart_filter-is* |
| Disallow | *? |
| Disallow | *%2C |
| Disallow | /*% |
| Disallow | /*.aspx |
| Disallow | /*.cfm |
| Disallow | /*.html |
| Disallow | */amp/ |
| Disallow | */admin/ |
| Disallow | /*.php |
| Disallow | */personal/ |
| Disallow | *javscript |
| Disallow | */cart/ |
| Disallow | */bitrix/ |
| Disallow | */tmp/ |
| Disallow | */auth/ |
| Disallow | */search/ |
| Disallow | /*/search/ |
| Disallow | /*/slide_show/ |
| Disallow | /*/gallery/*order%3D |
| Disallow | /*%26print%3D |
| Disallow | /*register%3D |
| Disallow | /*forgot_password%3D |
| Disallow | /*change_password%3D |
| Disallow | /*login |
| Disallow | /*logout |
| Disallow | /*auth |
| Disallow | /*action%3DADD_TO_COMPARE_LIST |
| Disallow | /*action%3DDELETE_FROM_COMPARE_LIST |
| Disallow | /*action%3DADD2BASKET |
| Disallow | /*action%3DBUY |
| Disallow | /*bitrix_ |
| Disallow | /*backurl%3D |
| Disallow | /*BACKURL%3D |
| Disallow | /*back_url%3D |
| Disallow | /*BACK_URL%3D |
| Disallow | /*back_url_admin%3D |
| Disallow | /*print_course%3DY |
| Disallow | /*COURSE_ID%3D |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | /*PAGE_NAME%3Dsearch |
| Disallow | /*PAGE_NAME%3Duser_post |
| Disallow | /*PAGE_NAME%3Ddetail_slide_show |
| Disallow | *SHOWALL |
| Disallow | *show_all%3D |
| Disallow | *tip_produkta |
| Disallow | */instructions/ |
| Disallow | */shtambovye-derevya_ |
| Disallow | */?bg= |
| Disallow | */?sa= |
| Disallow | *gclid* |
| Disallow | *yclid* |
| Disallow | *ysclid* |
| Disallow | *ymclid* |
| Disallow | *openstat* |
| Disallow | *frommarket* |
| Disallow | *utm_* |
| Disallow | *sort* |
| Disallow | *set_filter* |
| Disallow | *email* |
| Disallow | *bx_sender_conversion_id* |
| Disallow | *user* |
| Disallow | *USER_ID* |
| Disallow | *lang* |
| Disallow | *action* |
| Disallow | *print* |
| Disallow | *method%3Dasc* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vsesorta.ru/sitemap.xml |
Warnings
- 8 invalid lines.
- `clean-param` is not a known field.
Comments