rutube.ru
robots.txt
Robots Exclusion Standard data for rutube.ru
Resource Scan
Scan Details
| Site Domain | rutube.ru |
| Base Domain | rutube.ru |
| Scan Status | Ok |
| Last Scan | 2024-06-21T17:45:27+00:00 |
| Next Scan | 2024-06-28T17:45:27+00:00 |
Last Scan
| Scanned | 2024-06-21T17:45:27+00:00 |
| URL | https://rutube.ru/robots.txt |
| Domain IPs | 178.248.233.148 |
| Response IP | 178.248.233.148 |
| Found | Yes |
| Hash | c752e90f4945cbd982bd1c08a8ea0be42c56aa3af7011b84896ccd399b8ebcfa |
| SimHash | 0c1f2852b40f |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /forms/ |
| Disallow | /search/ |
| Disallow | /multipass/ |
| Disallow | /snake/ |
| Disallow | /nocreative/ |
| Disallow | /test/* |
| Disallow | /feeds/main3/ |
| Disallow | /feeds/main2/ |
| Disallow | /feeds/index/ |
| Disallow | /feeds/index1/ |
| Disallow | /forms/ |
| Disallow | /*limit%3D* |
| Disallow | *ordering%3D* |
| Disallow | /all* |
| Disallow | /subscribe/ |
| Disallow | /buy/ |
| Disallow | /player/ |
| Disallow | /player.swf |
| Disallow | /dom2/Flvplayer3.swf |
| Disallow | /dbg/ |
| Disallow | /cgi-bin/ |
| Disallow | /404.html |
| Disallow | /accounts/ |
| Disallow | /jsi18n/ |
| Disallow | /oembed/ |
| Disallow | /play/embed/ |
| Disallow | /video/embed/ |
| Disallow | /api/ |
| Disallow | /docs/api/ |
| Disallow | /reports/adfox/ |
| Disallow | /tv/ |
| Disallow | /*ref%3D* |
| Disallow | /uploader/ |
| Disallow | /profile/ |
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /*gelid%3D |
| Disallow | /mrss/ |
| Disallow | /rss/ |
| Disallow | /video/*.xml |
| Disallow | */info/memorandum |
| Disallow | */info/about_company |
| Disallow | */dev.rutube.ru |
| Disallow | /video/category/* |
| Disallow | /animations/ |
| Disallow | /chat/ |
| Disallow | /embeds/ |
| Disallow | /playlist/ |
| Disallow | /purchase-embed/ |
| Disallow | /login/ |
| Disallow | *page%3D* |
| Disallow | /uploader/ |
| Disallow | /pl/ |
| Disallow | /player?* |
| Disallow | /list/premier/ |
| Disallow | /dom2/draki0/ |
| Disallow | /multipass/api/ |
| Disallow | /channel/*/history/ |
| Disallow | /channel/*/favorites/ |
| Disallow | /channel/*/subscriptions/ |
| Disallow | /channel/*/liked/ |
| Disallow | /video/private/ |
| Disallow | /channel/24896177/* |
| Disallow | *? |
googlebot
| Rule | Path |
|---|---|
| Disallow | /forms/ |
| Disallow | /search/ |
| Disallow | /multipass/ |
| Disallow | /snake/ |
| Disallow | /nocreative/ |
| Disallow | /test/* |
| Disallow | /feeds/main3/ |
| Disallow | /feeds/main2/ |
| Disallow | /feeds/index/ |
| Disallow | /feeds/index1/ |
| Disallow | /forms/ |
| Disallow | /*limit%3D* |
| Disallow | *ordering%3D* |
| Disallow | /all* |
| Disallow | /subscribe/ |
| Disallow | /buy/ |
| Disallow | /player/ |
| Disallow | /player.swf |
| Disallow | /dom2/Flvplayer3.swf |
| Disallow | /dbg/ |
| Disallow | /cgi-bin/ |
| Disallow | /404.html |
| Disallow | /accounts/ |
| Disallow | /jsi18n/ |
| Disallow | /oembed/ |
| Disallow | /play/embed/ |
| Disallow | /video/embed/ |
| Disallow | /docs/api/ |
| Disallow | /reports/adfox/ |
| Disallow | /tv/ |
| Disallow | /*ref%3D* |
| Disallow | /uploader/ |
| Disallow | /profile/ |
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /*gelid%3D |
| Disallow | /mrss/ |
| Disallow | /rss/ |
| Disallow | /video/*.xml |
| Disallow | */info/memorandum |
| Disallow | */info/about_company |
| Disallow | */dev.rutube.ru |
| Disallow | /video/category/* |
| Disallow | /animations/ |
| Disallow | /chat/ |
| Disallow | /embeds/ |
| Disallow | /playlist/ |
| Disallow | /purchase-embed/ |
| Disallow | /login/ |
| Disallow | *page%3D* |
| Disallow | /uploader/ |
| Disallow | /pl/ |
| Disallow | /player?* |
| Disallow | /list/premier/ |
| Disallow | /dom2/draki0/ |
| Disallow | /multipass/api/ |
| Disallow | /channel/*/history/ |
| Disallow | /channel/*/favorites/ |
| Disallow | /channel/*/subscriptions/ |
| Disallow | /channel/*/liked/ |
| Disallow | /video/private/ |
| Disallow | /api/abtests/active-tests/* |
| Disallow | /api/metainfo/tv/* |
| Disallow | /multipass/api/accounts/* |
| Disallow | /api/meerkat/page/* |
| Disallow | /channel/24896177/* |
| Disallow | *? |
*
| Rule | Path |
|---|---|
| Disallow | /forms/ |
| Disallow | /search/ |
| Disallow | /multipass/ |
| Disallow | /snake/ |
| Disallow | /nocreative/ |
| Disallow | /test/* |
| Disallow | /feeds/main3/ |
| Disallow | /feeds/main2/ |
| Disallow | /feeds/index/ |
| Disallow | /feeds/index1/ |
| Disallow | /forms/ |
| Disallow | /*limit%3D* |
| Disallow | *ordering%3D* |
| Disallow | /all* |
| Disallow | /subscribe/ |
| Disallow | /buy/ |
| Disallow | /player/ |
| Disallow | /player.swf |
| Disallow | /dom2/Flvplayer3.swf |
| Disallow | /dbg/ |
| Disallow | /cgi-bin/ |
| Disallow | /404.html |
| Disallow | /accounts/ |
| Disallow | /jsi18n/ |
| Disallow | /oembed/ |
| Disallow | /play/embed/ |
| Disallow | /video/embed/ |
| Disallow | /docs/api/ |
| Disallow | /reports/adfox/ |
| Disallow | /tv/ |
| Disallow | /*ref%3D* |
| Disallow | /uploader/ |
| Disallow | /profile/ |
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /*gelid%3D |
| Disallow | /mrss/ |
| Disallow | /rss/ |
| Disallow | /video/*.xml |
| Disallow | */info/memorandum |
| Disallow | */info/about_company |
| Disallow | */dev.rutube.ru |
| Disallow | /video/category/* |
| Disallow | /animations/ |
| Disallow | /chat/ |
| Disallow | /embeds/ |
| Disallow | /playlist/ |
| Disallow | /purchase-embed/ |
| Disallow | /login/ |
| Disallow | *page%3D* |
| Disallow | /uploader/ |
| Disallow | /pl/ |
| Disallow | /player?* |
| Disallow | /list/premier/ |
| Disallow | /dom2/draki0/ |
| Disallow | /multipass/api/ |
| Disallow | /channel/*/history/ |
| Disallow | /channel/*/favorites/ |
| Disallow | /channel/*/subscriptions/ |
| Disallow | /channel/*/liked/ |
| Disallow | /video/private/ |
| Disallow | /api/abtests/active-tests/* |
| Disallow | /api/metainfo/tv/* |
| Disallow | /multipass/api/accounts/* |
| Disallow | /api/meerkat/page/* |
| Disallow | /channel/24896177/* |
| Disallow | *? |
bingbot
| Rule | Path |
|---|---|
| Disallow | /forms/ |
| Disallow | /search/ |
| Disallow | /nocreative/ |
| Disallow | /test/* |
| Disallow | /feeds/main3/ |
| Disallow | /feeds/main2/ |
| Disallow | /feeds/index/ |
| Disallow | /feeds/index1/ |
| Disallow | /forms/ |
| Disallow | /*limit%3D* |
| Disallow | *ordering%3D* |
| Disallow | /all* |
| Disallow | /subscribe/ |
| Disallow | /buy/ |
| Disallow | /player/ |
| Disallow | /player.swf |
| Disallow | /dom2/Flvplayer3.swf |
| Disallow | /dbg/ |
| Disallow | /cgi-bin/ |
| Disallow | /404.html |
| Disallow | /accounts/ |
| Disallow | /jsi18n/ |
| Disallow | /oembed/ |
| Disallow | /play/embed/ |
| Disallow | /video/embed/ |
| Disallow | /docs/api/ |
| Disallow | /reports/adfox/ |
| Disallow | /tv/ |
| Disallow | /*ref%3D* |
| Disallow | /uploader/ |
| Disallow | /profile/ |
| Disallow | /*_openstat |
| Disallow | /*from%3Dadwords |
| Disallow | /*gelid%3D |
| Disallow | /mrss/ |
| Disallow | /rss/ |
| Disallow | /video/*.xml |
| Disallow | */info/memorandum |
| Disallow | */info/about_company |
| Disallow | */dev.rutube.ru |
| Disallow | /video/category/* |
| Disallow | /animations/ |
| Disallow | /chat/ |
| Disallow | /embeds/ |
| Disallow | /playlist/ |
| Disallow | /purchase-embed/ |
| Disallow | /login/ |
| Disallow | *page%3D* |
| Disallow | /uploader/ |
| Disallow | /pl/ |
| Disallow | /player?* |
| Disallow | /list/premier/ |
| Disallow | /dom2/draki0/ |
| Disallow | /multipass/api/ |
| Disallow | /channel/*/history/ |
| Disallow | /channel/*/favorites/ |
| Disallow | /channel/*/subscriptions/ |
| Disallow | /channel/*/liked/ |
| Disallow | /video/private/ |
| Disallow | /api/abtests/active-tests/* |
| Disallow | /api/metainfo/tv/* |
| Disallow | /multipass/api/accounts/* |
| Disallow | /api/meerkat/page/* |
| Disallow | /channel/24896177/* |
| Disallow | *? |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rutube.ru/sitemap/yandex/index.xml |
| sitemap | https://rutube.ru/sitemap/yandex/daily-index.xml |
| sitemap | https://rutube.ru/sitemap/yandex/hot-index.xml |
| sitemap | https://rutube.ru/sitemap/google/index.xml |
| sitemap | https://rutube.ru/sitemap/google/daily-index.xml |
| sitemap | https://rutube.ru/sitemap/google/hot-index.xml |
Warnings
- `clean-param` is not a known field.