radiokot.ru
robots.txt
Robots Exclusion Standard data for radiokot.ru
Resource Scan
Scan Details
| Site Domain | radiokot.ru |
| Base Domain | radiokot.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-15T21:02:49+00:00 |
| Next Scan | 2024-11-22T21:02:49+00:00 |
Last Scan
| Scanned | 2024-11-15T21:02:49+00:00 |
| URL | https://radiokot.ru/robots.txt |
| Domain IPs | 185.178.209.20 |
| Response IP | 185.178.209.20 |
| Found | Yes |
| Hash | 305a237f8c1a981a0e71dc7dd6083bec1607aac41ef27161f54bf3511609341c |
| SimHash | 65581c7143a1 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /service |
| Disallow | /kz |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 20 |
Warnings
- `host` is not a known field.