rtraveler.ru
robots.txt
Robots Exclusion Standard data for rtraveler.ru
Resource Scan
Scan Details
| Site Domain | rtraveler.ru |
| Base Domain | rtraveler.ru |
| Scan Status | Ok |
| Last Scan | 2024-11-12T21:25:37+00:00 |
| Next Scan | 2024-11-19T21:25:37+00:00 |
Last Scan
| Scanned | 2024-11-12T21:25:37+00:00 |
| URL | https://rtraveler.ru/robots.txt |
| Domain IPs | 104.21.62.146, 172.67.168.93, 2606:4700:3031::ac43:a85d, 2606:4700:3032::6815:3e92 |
| Response IP | 172.67.168.93 |
| Found | Yes |
| Hash | 3901ba5d4c79739950b2ed15d754929a6aef73e68784bc6ffb1c71db4f7df3d6 |
| SimHash | 4949dc704f31 |
Groups
yandex
| Rule | Path |
|---|---|
| Allow | /out/yandex-news-all-articles.xml |
| Disallow | /test/*/result |
| Disallow | /test/*?result |
| Disallow | /test/*/1 |
| Disallow | /test/*/2 |
| Disallow | /test/*/3 |
| Disallow | /test/*/4 |
| Disallow | /test/*/5 |
| Disallow | /test/*/6 |
| Disallow | /test/*/7 |
| Disallow | /test/*/8 |
| Disallow | /test/*/9 |
| Disallow | /test/*/10 |
| Disallow | /community/* |
| Disallow | /photo/my |
| Disallow | /photo/upload |
| Disallow | /admin |
| Disallow | /400 |
| Disallow | /403 |
| Disallow | /404 |
| Disallow | /500 |
| Disallow |
*
| Rule | Path |
|---|---|
| Disallow | /test/*/result |
| Disallow | /test/*?result |
| Disallow | /test/*/1 |
| Disallow | /test/*/2 |
| Disallow | /test/*/3 |
| Disallow | /test/*/4 |
| Disallow | /test/*/5 |
| Disallow | /test/*/6 |
| Disallow | /test/*/7 |
| Disallow | /test/*/8 |
| Disallow | /test/*/9 |
| Disallow | /test/*/10 |
| Disallow | /community/* |
| Disallow | /photo/my |
| Disallow | /photo/upload |
| Disallow | /admin |
| Disallow | /static/embeds/* |
| Disallow | /400 |
| Disallow | /403 |
| Disallow | /404 |
| Disallow | /500 |
| Disallow | /static/embeds/* |
| Disallow | /embeds/* |
| Disallow | /away/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://rtraveler.ru/sitemap.xml |
Warnings
- `clean-param` is not a known field.
- `host` is not a known field.