monitex.com.ua
robots.txt
Robots Exclusion Standard data for monitex.com.ua
Resource Scan
Scan Details
| Site Domain | monitex.com.ua |
| Base Domain | monitex.com.ua |
| Scan Status | Ok |
| Last Scan | 2024-05-26T11:53:42+00:00 |
| Next Scan | 2024-06-25T11:53:42+00:00 |
Last Scan
| Scanned | 2024-05-26T11:53:42+00:00 |
| URL | https://monitex.com.ua/robots.txt |
| Domain IPs | 162.159.140.98, 172.66.0.96, 2606:4700:7::60, 2a06:98c1:58::60 |
| Response IP | 172.66.0.96 |
| Found | Yes |
| Hash | 8d2cd65642b8d03fe3da241fd70eb2ae8c0507e9498b69d1e620d1a19aa9d90c |
| SimHash | 4dc189c70530 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /*js |
| Allow | /*/*.js* |
| Allow | /*/*/*.js* |
| Allow | /*/*/*/*.js* |
| Allow | /*.css* |
| Allow | /*/*.css* |
| Allow | /*/*/*.css* |
| Allow | /*/*/*/*.css* |
| Allow | /*.jpg* |
| Allow | /*/*.jpg* |
| Allow | /*/*/*.jpg* |
| Allow | /*/*/*/*.jpg* |
| Allow | /*.png* |
| Allow | /*/*.png* |
| Allow | /*/*/*.png* |
| Disallow | /orders |
| Disallow | /dashboard |
| Disallow | /*search |
| Disallow | /recently |
| Disallow | /wishlist |
googlebot
| Rule | Path |
|---|---|
| Allow | /*js |
| Allow | /*/*.js* |
| Allow | /*/*/*.js* |
| Allow | /*/*/*/*.js* |
| Allow | /*.css* |
| Allow | /*/*.css* |
| Allow | /*/*/*.css* |
| Allow | /*/*/*/*.css* |
| Allow | /*.jpg* |
| Allow | /*/*.jpg* |
| Allow | /*/*/*.jpg* |
| Allow | /*/*/*/*.jpg* |
| Allow | /*.png* |
| Allow | /*/*.png* |
| Allow | /*/*/*.png* |
| Disallow | /orders |
| Disallow | /dashboard |
| Disallow | /*search |
| Disallow | /recently |
| Disallow | /wishlist |
mail.ru
| Rule | Path |
|---|---|
| Allow | /*js |
| Allow | /*/*.js* |
| Allow | /*/*/*.js* |
| Allow | /*/*/*/*.js* |
| Allow | /*.css* |
| Allow | /*/*.css* |
| Allow | /*/*/*.css* |
| Allow | /*/*/*/*.css* |
| Allow | /*.jpg* |
| Allow | /*/*.jpg* |
| Allow | /*/*/*.jpg* |
| Allow | /*/*/*/*.jpg* |
| Allow | /*.png* |
| Allow | /*/*.png* |
| Allow | /*/*/*.png* |
| Disallow | /orders |
| Disallow | /dashboard |
| Disallow | /*search |
| Disallow | /recently |
| Disallow | /wishlist |
*
| Rule | Path |
|---|---|
| Allow | /*js |
| Allow | /*/*.js* |
| Allow | /*/*/*.js* |
| Allow | /*/*/*/*.js* |
| Allow | /*.css* |
| Allow | /*/*.css* |
| Allow | /*/*/*.css* |
| Allow | /*/*/*/*.css* |
| Allow | /*.jpg* |
| Allow | /*/*.jpg* |
| Allow | /*/*/*.jpg* |
| Allow | /*/*/*/*.jpg* |
| Allow | /*.png* |
| Allow | /*/*.png* |
| Allow | /*/*/*.png* |
| Disallow | /orders |
| Disallow | /dashboard |
| Disallow | /*search |
| Disallow | /recently |
| Disallow | /wishlist |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 1 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://monitex.com.ua/sitemap.xml |
| sitemap | https://monitex.com.ua/sitemap-articles.xml |
| sitemap | https://monitex.com.ua/sitemap-categories.xml |
| sitemap | https://monitex.com.ua/sitemap-filter/ua.xml |
| sitemap | https://monitex.com.ua/sitemap-filter/ru.xml |
| sitemap | https://monitex.com.ua/sitemap-product/1.xml |
| sitemap | https://monitex.com.ua/sitemap-product/2.xml |
| sitemap | https://monitex.com.ua/sitemap-product/3.xml |
| sitemap | https://monitex.com.ua/sitemap-product/4.xml |
| sitemap | https://monitex.com.ua/sitemap-product/5.xml |
| sitemap | https://monitex.com.ua/sitemap-product/6.xml |
| sitemap | https://monitex.com.ua/sitemap-product/7.xml |
| sitemap | https://monitex.com.ua/sitemap-product/8.xml |
| sitemap | https://monitex.com.ua/sitemap-product/9.xml |
| sitemap | https://monitex.com.ua/sitemap-product/10.xml |
| sitemap | https://monitex.com.ua/sitemap-product/11.xml |
| sitemap | https://monitex.com.ua/sitemap-product/12.xml |
Warnings
- `host` is not a known field.
Comments