ntv-tv.ru
robots.txt
Robots Exclusion Standard data for ntv-tv.ru
Resource Scan
Scan Details
| Site Domain | ntv-tv.ru |
| Base Domain | ntv-tv.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-09T12:22:25+00:00 |
| Next Scan | 2024-11-16T12:22:25+00:00 |
Last Scan
| Scanned | 2024-11-09T12:22:25+00:00 |
| URL | http://ntv-tv.ru/robots.txt |
| Redirect | https://www.ntv.ru/robots.txt |
| Redirect Domain | www.ntv.ru |
| Redirect Base | ntv.ru |
| Domain IPs | 185.129.100.135 |
| Redirect IPs | 185.129.100.162, 185.129.100.166 |
| Response IP | 185.129.100.162 |
| Found | Yes |
| Hash | 7a0c0bed4f60601f1965f86e5f4a331df6099ae97a0a9e033db3270b4a326c2a |
| SimHash | 0e98aec25e93 |
Groups
telegrambot
| Rule | Path |
|---|---|
| Disallow | /video |
| Disallow | /embed |
| Disallow | /login |
| Disallow | /search |
| Disallow | /forms |
| Disallow | /ntv |
| Disallow | /finder |
| Disallow | /private |
yandex
| Rule | Path |
|---|---|
| Disallow | /embed |
| Disallow | /login |
| Disallow | /search |
| Disallow | /forms |
| Disallow | /ntv |
| Disallow | /finder |
| Disallow | /private |
| Disallow | /*/photogal/* |
| Disallow | /sobytie |
| Disallow | */comments |
| Disallow | */vcomments |
| Disallow | /video/embed |
| Disallow | /rest/ |
*
| Rule | Path |
|---|---|
| Disallow | /login |
| Disallow | /video/embed/* |
| Disallow | /search |
| Disallow | /forms |
| Disallow | /ntv |
| Disallow | /finder |
| Disallow | /private |
| Disallow | /rest |
| Disallow | /foto |
| Disallow | */comments |
| Disallow | */vcomments |
| Disallow | /sobytie |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.ntv.ru/exp/yandex/sitemap_last.jsp |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.