russiatoday.ru
robots.txt
Robots Exclusion Standard data for russiatoday.ru
Resource Scan
Scan Details
| Site Domain | russiatoday.ru |
| Base Domain | russiatoday.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-14T06:35:41+00:00 |
| Next Scan | 2024-11-21T06:35:41+00:00 |
Last Scan
| Scanned | 2024-11-14T06:35:41+00:00 |
| URL | https://russiatoday.ru/robots.txt |
| Domain IPs | 185.79.236.176, 89.191.237.194 |
| Response IP | 89.191.237.194 |
| Found | Yes |
| Hash | 70afe89685ff2998170cb7ca8b147eb1c8acc2ad086dc12002d427317eacd0a1 |
| SimHash | ef4d9143c5e3 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /inotv/print |
| Disallow | /search |
| Disallow | *? |
| Disallow | /c/ |
| Disallow | /nbc/ |
| Disallow | /nbc-stats/ |
| Disallow | /amp* |
| Disallow | /quiz/* |
| Allow | *css? |
| Allow | /static/fonts/icon/ |
| Allow | /static/css/ |
| Allow | /static/js/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /inotv/print |
| Disallow | /search |
| Disallow | /c/ |
| Disallow | /nbc/ |
| Disallow | /nbc-stats/ |
| Disallow | *? |
| Disallow | /widget/ |
| Disallow | /quiz/* |
| Allow | *css? |
| Allow | /static/fonts/icon/ |
| Allow | /static/css/ |
| Allow | /static/js/ |
*
| Rule | Path |
|---|---|
| Disallow | /inotv/print |
| Disallow | /search |
| Disallow | /c/ |
| Disallow | /nbc/ |
| Disallow | /nbc-stats/ |
| Disallow | *? |
| Disallow | /widget/ |
| Disallow | /quiz/* |
| Allow | *css? |
| Allow | /static/fonts/icon/ |
| Allow | /static/css/ |
| Allow | /static/js/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://russian.rt.com/sitemap.xml |
Warnings
- `host` is not a known field.