hitesti.com
robots.txt
Robots Exclusion Standard data for hitesti.com
Resource Scan
Scan Details
| Site Domain | hitesti.com |
| Base Domain | hitesti.com |
| Scan Status | Ok |
| Last Scan | 2024-10-03T11:00:59+00:00 |
| Next Scan | 2024-10-10T11:00:59+00:00 |
Last Scan
| Scanned | 2024-10-03T11:00:59+00:00 |
| URL | https://hitesti.com/robots.txt |
| Domain IPs | 185.142.34.127 |
| Response IP | 185.142.34.127 |
| Found | Yes |
| Hash | 1304982249ee5d26428ce0c241323ad33385db0498d14dca0923bd821c82f679 |
| SimHash | 881d81f04f30 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /compare/phone/ |
| Disallow | /phone/ |
| Disallow | /login |
| Disallow | /login |
| Disallow | /*?utm |
| Disallow | /*PAGEN |
| Disallow | /?fb_action_ids |
| Disallow | /?gtm_debug |
| Disallow | /?page |
| Disallow | /?sort |
| Disallow | /*.html$ |
| Disallow | /ru/ru/ |
| Disallow | /en/ru/ |
| Disallow | /es/ru/ |
| Disallow | /pt/ru/ |
| Disallow | /de/ru/ |
| Disallow | /fr/ru/ |
| Disallow | /it/ru/ |
| Disallow | /pl/ru/ |
| Disallow | /zh-CN/ru/ |
| Disallow | /ja/ru/ |
| Disallow | /ru/en/ |
| Disallow | /en/en/ |
| Disallow | /es/en/ |
| Disallow | /pt/en/ |
| Disallow | /de/en/ |
| Disallow | /fr/en/ |
| Disallow | /it/en/ |
| Disallow | /pl/en/ |
| Disallow | /zh-CN/en/ |
| Disallow | /ja/en/ |
| Disallow | /ru/es/ |
| Disallow | /en/es/ |
| Disallow | /es/es/ |
| Disallow | /pt/es/ |
| Disallow | /de/es/ |
| Disallow | /fr/es/ |
| Disallow | /it/es/ |
| Disallow | /pl/es/ |
| Disallow | /zh-CN/es/ |
| Disallow | /ja/es/ |
| Disallow | /ru/pt/ |
| Disallow | /en/pt/ |
| Disallow | /es/pt/ |
| Disallow | /pt/pt/ |
| Disallow | /de/pt/ |
| Disallow | /fr/pt/ |
| Disallow | /it/pt/ |
| Disallow | /pl/pt/ |
| Disallow | /zh-CN/pt/ |
| Disallow | /ja/pt/ |
| Disallow | /ru/de/ |
| Disallow | /en/de/ |
| Disallow | /es/de/ |
| Disallow | /pt/de/ |
| Disallow | /de/de/ |
| Disallow | /fr/de/ |
| Disallow | /it/de/ |
| Disallow | /pl/de/ |
| Disallow | /zh-CN/de/ |
| Disallow | /ja/de/ |
| Disallow | /ru/fr/ |
| Disallow | /en/fr/ |
| Disallow | /es/fr/ |
| Disallow | /pt/fr/ |
| Disallow | /de/fr/ |
| Disallow | /fr/fr/ |
| Disallow | /it/fr/ |
| Disallow | /pl/fr/ |
| Disallow | /zh-CN/fr/ |
| Disallow | /ja/fr/ |
| Disallow | /ru/it/ |
| Disallow | /en/it/ |
| Disallow | /es/it/ |
| Disallow | /pt/it/ |
| Disallow | /de/it/ |
| Disallow | /fr/it/ |
| Disallow | /it/it/ |
| Disallow | /pl/it/ |
| Disallow | /zh-CN/it/ |
| Disallow | /ja/it/ |
| Disallow | /ru/pl/ |
| Disallow | /en/pl/ |
| Disallow | /es/pl/ |
| Disallow | /pt/pl/ |
| Disallow | /de/pl/ |
| Disallow | /fr/pl/ |
| Disallow | /it/pl/ |
| Disallow | /pl/pl/ |
| Disallow | /zh-CN/pl/ |
| Disallow | /ja/pl/ |
| Disallow | /ru/zh-CN/ |
| Disallow | /en/zh-CN/ |
| Disallow | /es/zh-CN/ |
| Disallow | /pt/zh-CN/ |
| Disallow | /de/zh-CN/ |
| Disallow | /fr/zh-CN/ |
| Disallow | /it/zh-CN/ |
| Disallow | /pl/zh-CN/ |
| Disallow | /zh-CN/zh-CN/ |
| Disallow | /ja/zh-CN/ |
| Disallow | /ru/ja/ |
| Disallow | /en/ja/ |
| Disallow | /es/ja/ |
| Disallow | /pt/ja/ |
| Disallow | /de/ja/ |
| Disallow | /fr/ja/ |
| Disallow | /it/ja/ |
| Disallow | /pl/ja/ |
| Disallow | /zh-CN/ja/ |
| Disallow | /ja/ja/ |
xovibot
rogerbot
dotbot
amazonbot
petalbot
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
yandex
| Rule | Path |
|---|---|
| Disallow | |
| Disallow | /ru/ru/ |
| Disallow | /en/ru/ |
| Disallow | /es/ru/ |
| Disallow | /pt/ru/ |
| Disallow | /de/ru/ |
| Disallow | /fr/ru/ |
| Disallow | /it/ru/ |
| Disallow | /pl/ru/ |
| Disallow | /zh-CN/ru/ |
| Disallow | /ja/ru/ |
| Disallow | /ru/en/ |
| Disallow | /en/en/ |
| Disallow | /es/en/ |
| Disallow | /pt/en/ |
| Disallow | /de/en/ |
| Disallow | /fr/en/ |
| Disallow | /it/en/ |
| Disallow | /pl/en/ |
| Disallow | /zh-CN/en/ |
| Disallow | /ja/en/ |
| Disallow | /ru/es/ |
| Disallow | /en/es/ |
| Disallow | /es/es/ |
| Disallow | /pt/es/ |
| Disallow | /de/es/ |
| Disallow | /fr/es/ |
| Disallow | /it/es/ |
| Disallow | /pl/es/ |
| Disallow | /zh-CN/es/ |
| Disallow | /ja/es/ |
| Disallow | /ru/pt/ |
| Disallow | /en/pt/ |
| Disallow | /es/pt/ |
| Disallow | /pt/pt/ |
| Disallow | /de/pt/ |
| Disallow | /fr/pt/ |
| Disallow | /it/pt/ |
| Disallow | /pl/pt/ |
| Disallow | /zh-CN/pt/ |
| Disallow | /ja/pt/ |
| Disallow | /ru/de/ |
| Disallow | /en/de/ |
| Disallow | /es/de/ |
| Disallow | /pt/de/ |
| Disallow | /de/de/ |
| Disallow | /fr/de/ |
| Disallow | /it/de/ |
| Disallow | /pl/de/ |
| Disallow | /zh-CN/de/ |
| Disallow | /ja/de/ |
| Disallow | /ru/fr/ |
| Disallow | /en/fr/ |
| Disallow | /es/fr/ |
| Disallow | /pt/fr/ |
| Disallow | /de/fr/ |
| Disallow | /fr/fr/ |
| Disallow | /it/fr/ |
| Disallow | /pl/fr/ |
| Disallow | /zh-CN/fr/ |
| Disallow | /ja/fr/ |
| Disallow | /ru/it/ |
| Disallow | /en/it/ |
| Disallow | /es/it/ |
| Disallow | /pt/it/ |
| Disallow | /de/it/ |
| Disallow | /fr/it/ |
| Disallow | /it/it/ |
| Disallow | /pl/it/ |
| Disallow | /zh-CN/it/ |
| Disallow | /ja/it/ |
| Disallow | /ru/pl/ |
| Disallow | /en/pl/ |
| Disallow | /es/pl/ |
| Disallow | /pt/pl/ |
| Disallow | /de/pl/ |
| Disallow | /fr/pl/ |
| Disallow | /it/pl/ |
| Disallow | /pl/pl/ |
| Disallow | /zh-CN/pl/ |
| Disallow | /ja/pl/ |
| Disallow | /ru/zh-CN/ |
| Disallow | /en/zh-CN/ |
| Disallow | /es/zh-CN/ |
| Disallow | /pt/zh-CN/ |
| Disallow | /de/zh-CN/ |
| Disallow | /fr/zh-CN/ |
| Disallow | /it/zh-CN/ |
| Disallow | /pl/zh-CN/ |
| Disallow | /zh-CN/zh-CN/ |
| Disallow | /ja/zh-CN/ |
| Disallow | /ru/ja/ |
| Disallow | /en/ja/ |
| Disallow | /es/ja/ |
| Disallow | /pt/ja/ |
| Disallow | /de/ja/ |
| Disallow | /fr/ja/ |
| Disallow | /it/ja/ |
| Disallow | /pl/ja/ |
| Disallow | /zh-CN/ja/ |
| Disallow | /ja/ja/ |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.