rambler.ru
robots.txt
Robots Exclusion Standard data for rambler.ru
Resource Scan
Scan Details
| Site Domain | rambler.ru |
| Base Domain | rambler.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-08T17:54:49+00:00 |
| Next Scan | 2024-11-15T17:54:49+00:00 |
Last Scan
| Scanned | 2024-11-08T17:54:49+00:00 |
| URL | https://rambler.ru/robots.txt |
| Redirect | https://www.rambler.ru/robots.txt |
| Redirect Domain | www.rambler.ru |
| Redirect Base | rambler.ru |
| Domain IPs | 81.19.82.0, 81.19.82.1, 81.19.82.2 |
| Redirect IPs | 81.19.82.0, 81.19.82.1, 81.19.82.2 |
| Response IP | 81.19.82.0 |
| Found | Yes |
| Hash | 972cbc26b36a4d1d9c34d80450f60394292bed0d689d46073a89a99f42446704 |
| SimHash | 49029a42c7d3 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /doc/addr.shtml |
| Allow | /doc/history.shtml |
| Allow | /doc/about.shtml |
| Disallow | /photo/ |
| Disallow | /pobeda/ |
| Disallow | /db/ |
| Disallow | /news/ |
| Disallow | /cgi-bin/ |
| Disallow | /srch |
| Disallow | /lite |
| Disallow | /doc/ |
| Disallow | /special |
| Disallow | /view |
| Disallow | /block |
| Disallow | /frame_main.html |
| Disallow | /player |
| Disallow | /xpromo_static |
| Disallow | /rubicon_rambler_main |
| Disallow | /rnet/ |
| Disallow | /?query=* |
googlebot
| Rule | Path |
|---|---|
| Allow | /doc/addr.shtml |
| Allow | /doc/history.shtml |
| Allow | /doc/about.shtml |
| Disallow | /photo/ |
| Disallow | /pobeda/ |
| Disallow | /db/ |
| Disallow | /news/ |
| Disallow | /cgi-bin/ |
| Disallow | /srch |
| Disallow | /lite |
| Disallow | /doc/ |
| Disallow | /special |
| Disallow | /view |
| Disallow | /block |
| Disallow | /frame_main.html |
| Disallow | /player |
| Disallow | /xpromo_static |
| Disallow | /rubicon_rambler_main |
| Disallow | /rnet/ |
| Disallow | /?query=* |
| Disallow | /?clid=* |
| Disallow | /location/current |
| Disallow | /api/v4/weather/ |
| Disallow | /api/v4/rcm/* |
*
| Rule | Path |
|---|---|
| Allow | /doc/addr.shtml |
| Allow | /doc/history.shtml |
| Allow | /doc/about.shtml |
| Disallow | /photo/ |
| Disallow | /pobeda/ |
| Disallow | /db/ |
| Disallow | /news/ |
| Disallow | /cgi-bin/ |
| Disallow | /srch |
| Disallow | /lite |
| Disallow | /doc/ |
| Disallow | /special |
| Disallow | /view |
| Disallow | /block |
| Disallow | /frame_main.html |
| Disallow | /player |
| Disallow | /xpromo_static |
| Disallow | /rubicon_rambler_main |
| Disallow | /rnet/ |
| Disallow | /?query=* |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.