rg.ru
robots.txt
Robots Exclusion Standard data for rg.ru
Resource Scan
Scan Details
| Site Domain | rg.ru |
| Base Domain | rg.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-09T16:38:04+00:00 |
| Next Scan | 2024-05-16T16:38:04+00:00 |
Last Scan
| Scanned | 2024-05-09T16:38:04+00:00 |
| URL | https://rg.ru/robots.txt |
| Domain IPs | 185.65.148.114 |
| Response IP | 185.65.148.114 |
| Found | Yes |
| Hash | 6763114cc5c9132aca6f4c086157b157d6c9b2019e56c02e9f8c872f23b906fe |
| SimHash | 8b3509c4f0b7 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /printable/ |
| Disallow | */.html |
| Disallow | /*.flv$ |
| Disallow | /*.swf$ |
| Disallow | /banners_test/* |
| Disallow | /collection/* |
| Disallow | /include_xml/* |
| Disallow | /include/* |
| Disallow | /bussines/* |
| Disallow | /anons/* |
| Disallow | /oficial/* |
| Disallow | /proekt/* |
| Disallow | /prilog/* |
| Disallow | /teoria/* |
| Disallow | /mics/* |
| Disallow | /bulgakov/* |
| Disallow | /telldoc/* |
| Disallow | /billiard/* |
| Disallow | /arhiv/* |
| Disallow | /nomera/* |
| Disallow | /amp/ |
| Disallow | /preview/ |
| Disallow | /staffonly/ |
| Disallow | /spec_v2/ |
| Disallow | */search |
| Disallow | /doc-search |
| Disallow | /account/* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /printable/ |
| Disallow | */.html |
| Disallow | /*.flv$ |
| Disallow | /*.swf$ |
| Disallow | /banners_test/* |
| Disallow | /collection/* |
| Disallow | /include_xml/* |
| Disallow | /include/* |
| Disallow | /bussines/* |
| Disallow | /anons/* |
| Disallow | /oficial/* |
| Disallow | /proekt/* |
| Disallow | /prilog/* |
| Disallow | /teoria/* |
| Disallow | /mics/* |
| Disallow | /bulgakov/* |
| Disallow | /telldoc/* |
| Disallow | /billiard/* |
| Disallow | /arhiv/* |
| Disallow | /nomera/* |
| Disallow | /preview/ |
| Disallow | /staffonly/ |
| Disallow | /spec_v2/ |
| Disallow | */search |
| Disallow | /doc-search |
| Disallow | /account/* |
*
| Rule | Path |
|---|---|
| Disallow | /printable/ |
| Disallow | */.html |
| Disallow | /*.flv$ |
| Disallow | /*.swf$ |
| Disallow | /banners_test/* |
| Disallow | /collection/* |
| Disallow | /include_xml/* |
| Disallow | /include/* |
| Disallow | /bussines/* |
| Disallow | /anons/* |
| Disallow | /oficial/* |
| Disallow | /proekt/* |
| Disallow | /prilog/* |
| Disallow | /teoria/* |
| Disallow | /mics/* |
| Disallow | /bulgakov/* |
| Disallow | /telldoc/* |
| Disallow | /billiard/* |
| Disallow | /arhiv/* |
| Disallow | /nomera/* |
| Disallow | /preview/ |
| Disallow | /staffonly/ |
| Disallow | /spec_v2/ |
| Disallow | */search |
| Disallow | /doc-search |
| Disallow | /account/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rg.ru/sitemaps/index.xml |
Warnings
- `clean-param` is not a known field.