travel.rian.ru
robots.txt
Robots Exclusion Standard data for travel.rian.ru
Resource Scan
Scan Details
| Site Domain | travel.rian.ru |
| Base Domain | rian.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-12T00:00:22+00:00 |
| Next Scan | 2024-11-19T00:00:22+00:00 |
Last Scan
| Scanned | 2024-11-12T00:00:22+00:00 |
| URL | http://travel.rian.ru/robots.txt |
| Redirect | https://ria.ru/robots.txt |
| Redirect Domain | ria.ru |
| Redirect Base | ria.ru |
| Domain IPs | 194.190.139.47 |
| Redirect IPs | 194.190.139.47 |
| Response IP | 194.190.139.47 |
| Found | Yes |
| Hash | cc1484b5f4f2804e9ec27fe172015691bb1a5ab5401cb18035d960510c28ff7a |
| SimHash | 6df85d818ab3 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | *-print.html$ |
| Disallow | /sys_* |
| Disallow | /valdai/ |
| Disallow | /search/ |
| Disallow | /ria_70* |
| Disallow | /test_adfox* |
| Disallow | /ecokarta* |
| Disallow | /id/ |
| Disallow | */embed/ |
| Disallow | /specialprojects/ |
| Disallow | /_editorial_preview_* |
| Disallow | /amp/*/more.html* |
| Disallow | /?* |
| Disallow | /services/ |
| Disallow | *%7B%7B* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://ria.ru/sitemap_article_index.xml |
| sitemap | https://ria.ru/sitemap_list_index.xml |
| sitemap | https://ria.ru/sitemap_archive.xml |
Warnings
- `clean-param` is not a known field.