rg.ru
robots.txt
Robots Exclusion Standard data for rg.ru
Resource Scan
Scan Details
| Site Domain | rg.ru |
| Base Domain | rg.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-08T08:23:35+00:00 |
| Next Scan | 2024-11-15T08:23:35+00:00 |
Last Scan
| Scanned | 2024-11-08T08:23:35+00:00 |
| URL | https://rg.ru/robots.txt |
| Domain IPs | 185.65.148.114 |
| Response IP | 185.65.148.114 |
| Found | Yes |
| Hash | 21f8c01fe7dcff932968da4237e7477a6ed6b2da50351201510311119b05c3ea |
| SimHash | 8b7509c0f0b3 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /printable/ |
| Disallow | */.html |
| Disallow | /*.flv$ |
| Disallow | /*.swf$ |
| Disallow | /banners_test/* |
| Disallow | /collection/* |
| Disallow | /include_xml/* |
| Disallow | /include/* |
| Disallow | /bussines/* |
| Disallow | /anons/* |
| Disallow | /oficial/* |
| Disallow | /proekt/* |
| Disallow | /prilog/* |
| Disallow | /teoria/* |
| Disallow | /mics/* |
| Disallow | /bulgakov/* |
| Disallow | /telldoc/* |
| Disallow | /billiard/* |
| Disallow | /arhiv/* |
| Disallow | /nomera/* |
| Disallow | /amp/ |
| Disallow | /preview/ |
| Disallow | /staffonly/ |
| Disallow | /spec_v2/ |
| Disallow | */search |
| Disallow | /doc-search |
| Disallow | /account/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /printable/ |
| Disallow | */.html |
| Disallow | /*.flv$ |
| Disallow | /*.swf$ |
| Disallow | /banners_test/* |
| Disallow | /collection/* |
| Disallow | /include_xml/* |
| Disallow | /include/* |
| Disallow | /bussines/* |
| Disallow | /anons/* |
| Disallow | /oficial/* |
| Disallow | /proekt/* |
| Disallow | /prilog/* |
| Disallow | /teoria/* |
| Disallow | /mics/* |
| Disallow | /bulgakov/* |
| Disallow | /telldoc/* |
| Disallow | /billiard/* |
| Disallow | /arhiv/* |
| Disallow | /nomera/* |
| Disallow | /preview/ |
| Disallow | /staffonly/ |
| Disallow | /spec_v2/ |
| Disallow | */search |
| Disallow | /doc-search |
| Disallow | /account/* |
*
| Rule | Path |
|---|---|
| Disallow | /printable/ |
| Disallow | */.html |
| Disallow | /*.flv$ |
| Disallow | /*.swf$ |
| Disallow | /banners_test/* |
| Disallow | /collection/* |
| Disallow | /include_xml/* |
| Disallow | /include/* |
| Disallow | /bussines/* |
| Disallow | /anons/* |
| Disallow | /oficial/* |
| Disallow | /proekt/* |
| Disallow | /prilog/* |
| Disallow | /teoria/* |
| Disallow | /mics/* |
| Disallow | /bulgakov/* |
| Disallow | /telldoc/* |
| Disallow | /billiard/* |
| Disallow | /arhiv/* |
| Disallow | /nomera/* |
| Disallow | /preview/ |
| Disallow | /staffonly/ |
| Disallow | /spec_v2/ |
| Disallow | */search |
| Disallow | /doc-search |
| Disallow | /account/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rg.ru/sitemaps/index.xml |
Warnings
- `clean-param` is not a known field.