prognozist.ru
robots.txt
Robots Exclusion Standard data for prognozist.ru
Resource Scan
Scan Details
| Site Domain | prognozist.ru |
| Base Domain | prognozist.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-25T17:19:18+00:00 |
| Next Scan | 2024-06-01T17:19:18+00:00 |
Last Scan
| Scanned | 2024-05-25T17:19:18+00:00 |
| URL | https://prognozist.ru/robots.txt |
| Domain IPs | 104.26.10.213, 104.26.11.213, 172.67.73.173, 2606:4700:20::681a:ad5, 2606:4700:20::681a:bd5, 2606:4700:20::ac43:49ad |
| Response IP | 172.67.73.173 |
| Found | Yes |
| Hash | c11bfdef0e4ceca99f2e8a251a11bfcb3dc5d041c1d91328d484d343bed72a8e |
| SimHash | 711c9e235318 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /newposts/ |
| Disallow | |
| Disallow | /index.php |
| Disallow | /go/ |
| Disallow | /line/ |
| Disallow | /archiv/ |
| Disallow | /chat/history/ |
| Disallow | /?do= |
*
| Rule | Path |
|---|---|
| Disallow | /newposts/ |
| Disallow | |
| Disallow | /index.php |
| Disallow | /go/ |
| Disallow | /line/ |
| Disallow | /archiv/ |
| Disallow | /chat/history/ |
| Disallow | /?do= |
Warnings
- `host` is not a known field.