russian.rt.com
robots.txt
Robots Exclusion Standard data for russian.rt.com
Resource Scan
Scan Details
| Site Domain | russian.rt.com |
| Base Domain | rt.com |
| Scan Status | Ok |
| Last Scan | 2024-04-18T14:29:44+00:00 |
| Next Scan | 2024-05-18T14:29:44+00:00 |
Last Scan
| Scanned | 2024-04-18T14:29:44+00:00 |
| URL | https://russian.rt.com/robots.txt |
| Domain IPs | 91.215.41.9 |
| Response IP | 91.215.41.9 |
| Found | Yes |
| Hash | 70afe89685ff2998170cb7ca8b147eb1c8acc2ad086dc12002d427317eacd0a1 |
| SimHash | ef4d9143c5e3 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /inotv/print |
| Disallow | /search |
| Disallow | *? |
| Disallow | /c/ |
| Disallow | /nbc/ |
| Disallow | /nbc-stats/ |
| Disallow | /amp* |
| Disallow | /quiz/* |
| Allow | *css? |
| Allow | /static/fonts/icon/ |
| Allow | /static/css/ |
| Allow | /static/js/ |
googlebot
| Rule | Path |
|---|---|
| Disallow | /inotv/print |
| Disallow | /search |
| Disallow | /c/ |
| Disallow | /nbc/ |
| Disallow | /nbc-stats/ |
| Disallow | *? |
| Disallow | /widget/ |
| Disallow | /quiz/* |
| Allow | *css? |
| Allow | /static/fonts/icon/ |
| Allow | /static/css/ |
| Allow | /static/js/ |
*
| Rule | Path |
|---|---|
| Disallow | /inotv/print |
| Disallow | /search |
| Disallow | /c/ |
| Disallow | /nbc/ |
| Disallow | /nbc-stats/ |
| Disallow | *? |
| Disallow | /widget/ |
| Disallow | /quiz/* |
| Allow | *css? |
| Allow | /static/fonts/icon/ |
| Allow | /static/css/ |
| Allow | /static/js/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://russian.rt.com/sitemap.xml |
Warnings
- `host` is not a known field.