lenta.kharkiv.ua
robots.txt
Robots Exclusion Standard data for lenta.kharkiv.ua
Resource Scan
Scan Details
| Site Domain | lenta.kharkiv.ua |
| Base Domain | lenta.kharkiv.ua |
| Scan Status | Ok |
| Last Scan | 2025-04-15T06:48:19+00:00 |
| Next Scan | 2025-04-22T06:48:19+00:00 |
Last Scan
| Scanned | 2025-04-15T06:48:19+00:00 |
| URL | https://lenta.kharkiv.ua/robots.txt |
| Domain IPs | 104.21.43.70, 172.67.221.240, 2606:4700:3033::6815:2b46, 2606:4700:3035::ac43:ddf0 |
| Response IP | 104.21.43.70 |
| Found | Yes |
| Hash | 602264ee00918b743c8a39a5bacae64de8a850ea4274b66377947484101bd091 |
| SimHash | 6f08ca42c992 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /search |
| Disallow | /api |
Other Records
| Field | Value |
|---|---|
| sitemap | https://lenta.kharkiv.ua/sitemap.xml |
Warnings
- `host` is not a known field.