rt.com
robots.txt
Robots Exclusion Standard data for rt.com
Resource Scan
Scan Details
Site Domain | rt.com |
Base Domain | rt.com |
Scan Status | Ok |
Last Scan | 2024-04-21T15:50:00+00:00 |
Next Scan | 2024-04-28T15:50:00+00:00 |
Last Scan
Scanned | 2024-04-21T15:50:00+00:00 |
URL | https://rt.com/robots.txt |
Redirect | https://www.rt.com/robots.txt |
Redirect Domain | www.rt.com |
Redirect Base | rt.com |
Domain IPs | 91.215.41.4 |
Redirect IPs | 91.215.41.4 |
Response IP | 91.215.41.4 |
Found | Yes |
Hash | 0fbcb788f55978521bd78addecea6b1c48726572c0e1fbb274c4e20c7f2b98c9 |
SimHash | c93b5135c7a8 |
Groups
googlebot
Rule | Path |
---|---|
Disallow | /search* |
Disallow | /preview* |
Disallow | /register* |
Disallow | /login* |
Disallow | /requestresetpass* |
Disallow | /*/video/ |
Disallow | /shortcode/ |
Disallow | /preview/ |
Disallow | /api/ |
Disallow | /rtmobile/ |
Disallow | /listing/ |
Disallow | /widget/ |
Disallow | /schedulejson/ |
Disallow | /vote/ |
Disallow | /russia-today |
Disallow | /russia-today/ |
Disallow | *? |
Allow | /static/fonts/icon/ |
Allow | /static/css/ |
Allow | /static/js/ |
bingbot
Rule | Path |
---|---|
Disallow | /search* |
Disallow | /preview* |
Disallow | /register* |
Disallow | /login* |
Disallow | /requestresetpass* |
Disallow | /*/video/ |
Disallow | /shortcode/ |
Disallow | /preview/ |
Disallow | /api/ |
Disallow | /rtmobile/ |
Disallow | /listing/ |
Disallow | /widget/ |
Disallow | /schedulejson/ |
Disallow | /vote/ |
Disallow | *? |
Allow | /static/fonts/icon/ |
Allow | /static/css/ |
Allow | /static/js/ |
*
Rule | Path |
---|---|
Disallow | /search* |
Disallow | /preview* |
Disallow | /register* |
Disallow | /login* |
Disallow | /requestresetpass* |
Disallow | /*/video/ |
Disallow | /shortcode/ |
Disallow | /preview/ |
Disallow | /api/ |
Disallow | /rtmobile/ |
Disallow | /listing/ |
Disallow | /widget/ |
Disallow | /schedulejson/ |
Disallow | /vote/ |
Disallow | *? |
Allow | /static/fonts/icon/ |
Allow | /static/css/ |
Allow | /static/js/ |
Other Records
Field | Value |
---|---|
sitemap | https://www.rt.com/sitemap.xml |
sitemap | https://www.rt.com/newssitemap.xml |