univex.ru
robots.txt
Robots Exclusion Standard data for univex.ru
Resource Scan
Scan Details
| Site Domain | univex.ru |
| Base Domain | univex.ru |
| Scan Status | Ok |
| Last Scan | 2024-09-06T11:34:58+00:00 |
| Next Scan | 2024-10-06T11:34:58+00:00 |
Last Scan
| Scanned | 2024-09-06T11:34:58+00:00 |
| URL | https://univex.ru/robots.txt |
| Domain IPs | 89.253.237.41 |
| Response IP | 89.253.237.41 |
| Found | Yes |
| Hash | 128988168649dc1b3aa034a71ae44be14a1bc4400561c85990b7c04845f790c9 |
| SimHash | 625ccc652e93 |
Groups
yandexbot
| Rule | Path |
|---|---|
| Disallow | /2181963b8c41c863b0ab12b94d40f244/ |
| Disallow | /_cms/ |
| Disallow | /_cms.bak/ |
| Disallow | /_db_cms/ |
| Disallow | /css/ |
| Disallow | /export/ |
| Disallow | /picture_library/ |
| Disallow | /plesk-stat/ |
| Disallow | /pricelist/ |
| Disallow | /r/ |
| Disallow | /server-status/ |
| Disallow | /techdocs/ |
| Disallow | /tpl/ |
| Disallow | /tpl.bak/ |
| Disallow | /upload/export/ |
| Disallow | /upload/export.bak/ |
| Disallow | /upload/navision/ |
| Disallow | /catalogue/cart/ |
| Disallow | /catalogue/cart/add/ |
| Disallow | /catalogue/history/ |
| Disallow | /catalogue/order/ |
| Disallow | /cabinet/* |
| Disallow | /filial/* |
| Disallow | /novelty/ |
| Disallow | /catalogue/search/ |
| Allow | /catalogue/manufacturer/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot
| Rule | Path |
|---|---|
| Disallow | /2181963b8c41c863b0ab12b94d40f244/ |
| Disallow | /_cms/ |
| Disallow | /_cms.bak/ |
| Disallow | /_db_cms/ |
| Disallow | /css/ |
| Disallow | /export/ |
| Disallow | /picture_library/ |
| Disallow | /plesk-stat/ |
| Disallow | /pricelist/ |
| Disallow | /r/ |
| Disallow | /server-status/ |
| Disallow | /techdocs/ |
| Disallow | /tpl/ |
| Disallow | /tpl.bak/ |
| Disallow | /upload/export/ |
| Disallow | /upload/export.bak/ |
| Disallow | /upload/navision/ |
| Disallow | /catalogue/cart/ |
| Disallow | /catalogue/cart/add/ |
| Disallow | /catalogue/history/ |
| Disallow | /catalogue/order/ |
| Disallow | /cabinet/* |
| Disallow | /filial/* |
| Disallow | /novelty/ |
| Disallow | /catalogue/search/ |
| Allow | /catalogue/manufacturer/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yandexmedia
| Rule | Path |
|---|---|
| Allow | /upload/univex/shop_rubric_item/image/ |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
yandeximages
| Rule | Path |
|---|---|
| Allow | /upload/univex/shop_rubric_item/image/ |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
googlebot-image
| Rule | Path |
|---|---|
| Allow | /upload/univex/shop_rubric_item/image/ |
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
*
| Rule | Path |
|---|---|
| Disallow | /2181963b8c41c863b0ab12b94d40f244/ |
| Disallow | /_cms/ |
| Disallow | /_cms.bak/ |
| Disallow | /_db_cms/ |
| Disallow | /css/ |
| Disallow | /export/ |
| Disallow | /picture_library/ |
| Disallow | /plesk-stat/ |
| Disallow | /pricelist/ |
| Disallow | /r/ |
| Disallow | /server-status/ |
| Disallow | /techdocs/ |
| Disallow | /tpl/ |
| Disallow | /tpl.bak/ |
| Disallow | /upload/export/ |
| Disallow | /upload/export.bak/ |
| Disallow | /upload/navision/ |
| Disallow | /catalogue/cart/ |
| Disallow | /catalogue/cart/add/ |
| Disallow | /catalogue/history/ |
| Disallow | /catalogue/order/ |
| Disallow | /cabinet/* |
| Disallow | /filial/* |
| Disallow | /novelty/ |
| Disallow | /catalogue/search/ |
| Allow | /catalogue/manufacturer/* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 15 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.univex.ru/sitemap.xml |
Warnings
- `host` is not a known field.