vsexshop.ru
robots.txt
Robots Exclusion Standard data for vsexshop.ru
Resource Scan
Scan Details
| Site Domain | vsexshop.ru |
| Base Domain | vsexshop.ru |
| Scan Status | Ok |
| Last Scan | 2024-10-22T09:41:31+00:00 |
| Next Scan | 2024-11-21T09:41:31+00:00 |
Last Scan
| Scanned | 2024-10-22T09:41:31+00:00 |
| URL | https://vsexshop.ru/robots.txt |
| Domain IPs | 185.189.195.74 |
| Response IP | 185.189.195.74 |
| Found | Yes |
| Hash | 8a23a1921fb57cc378722966b41168b46f8070662405bd715cfd6a687c9e6a36 |
| SimHash | 5c070f750693 |
Groups
yandexbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | *p_high |
| Disallow | *p_id |
| Disallow | *l_high |
| Disallow | *d_high |
| Disallow | /orders |
| Disallow | /store/add_to_cart |
| Disallow | /store/add_both |
| Disallow | /store/search |
| Disallow | /store/refine_search |
| Disallow | /account |
| Disallow | /games |
| Disallow | /store/display_cart |
| Disallow | /store/nojsindex/ |
| Disallow | /store/diameter |
| Disallow | /store/search |
| Disallow | *useful |
| Disallow | /*price%5Bmin%5D%3D |
| Disallow | /store/cart/add |
| Disallow | /store/recommendations |
| Disallow | /new_admin/ |
| Disallow | /store/customer_surveys |
| Disallow | /store/index/recommendations/true |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
googlebot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | *p_high |
| Disallow | *p_id |
| Disallow | *d_high |
| Disallow | *useful |
| Disallow | /store/customer_surveys |
| Disallow | /store/index/recommendations/true |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
| crawl-delay | 2 |
bingbot
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | *p_high |
| Disallow | *p_id |
| Disallow | *d_high |
| Disallow | *useful |
| Disallow | /orders |
| Disallow | /store/add_to_cart |
| Disallow | /store/add_both |
| Disallow | /store/search |
| Disallow | /store/refine_search |
| Disallow | /store/cart/also_view |
| Disallow | /store/cart/small_cart.js |
| Disallow | /account |
| Disallow | /games |
| Disallow | /new_admin |
| Disallow | /store/display_cart |
| Disallow | /store/nojsindex/ |
| Disallow | /store/diameter |
| Disallow | /store/search |
| Disallow | /*useful |
| Disallow | /*selfpickup%3D |
| Disallow | /*price%5Bmin%5D%3D |
| Disallow | /store/cart/add |
| Disallow | /store/recommendations |
| Disallow | /store/index/recommendations/true |
| Disallow | /store/partner_sale_category |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
| crawl-delay | 5 |
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /api/ |
| Disallow | *p_high |
| Disallow | *l_high |
| Disallow | *p_id |
| Disallow | *d_high |
| Disallow | *useful |
| Disallow | /store/display_fresh_cart |
| Disallow | /account |
| Disallow | /store/write_review |
| Disallow | /store/add_to_cart |
| Disallow | /store/add_both |
| Disallow | /orders |
| Disallow | /account |
| Disallow | /store/search |
| Disallow | /store/refine_search |
| Disallow | /store/nojsindex/ |
| Disallow | /store/diameter/ |
| Disallow | /store/display_cart |
| Disallow | /store/cart/also_view |
| Disallow | /store/cart/small_cart.js |
| Disallow | /account/add_to_wishlist |
| Disallow | /*price%5Bmin%5D%3D |
| Disallow | /store/cart/add |
| Disallow | /store/recommendations |
| Disallow | /new_admin |
| Disallow | /store/partner_sale_category |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 2 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://vsexshop.ru/sitemapindex.xml |
| sitemap | http://vsexshop.ru/sitemapindex.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.