travel.yandex.ru
robots.txt
Robots Exclusion Standard data for travel.yandex.ru
Resource Scan
Scan Details
| Site Domain | travel.yandex.ru |
| Base Domain | yandex.ru |
| Scan Status | Ok |
| Last Scan | 2024-05-19T14:08:40+00:00 |
| Next Scan | 2024-06-02T14:08:40+00:00 |
Last Scan
| Scanned | 2024-05-19T14:08:40+00:00 |
| URL | https://travel.yandex.ru/robots.txt |
| Domain IPs | 2a02:6b8::45a, 93.158.134.81 |
| Response IP | 93.158.134.81 |
| Found | Yes |
| Hash | b8428775b1ea2aca10829b382ab7f0ed9f07c078b69550ea65a7f28f70c84c2b |
| SimHash | 084255d0dc12 |
Groups
yandex
| Rule | Path |
|---|---|
| Disallow | /?* |
| Disallow | /*/search* |
| Disallow | /*/order* |
| Disallow | /*/orders* |
| Disallow | /*/redirect* |
| Disallow | /*when%3D* |
| Disallow | /trains/*/20* |
| Disallow | /hotels/*checkinDate%3D* |
| Disallow | */hotel/*/* |
| Disallow | /buses/*date%3D* |
| Disallow | /avia/toCountry/ |
| Disallow | /avia/toAnywhere/ |
| Disallow | */book/* |
| Disallow | */booking/* |
| Disallow | /my* |
| Disallow | /incompatible/ |
| Disallow | /favorites/ |
| Disallow | /redir* |
| Disallow | /gate/ |
| Disallow | /api/ |
| Disallow | /amp/ |
| Disallow | /journal/writing/* |
| Allow | /journal/ |
| Disallow | /extranet/ |
| Allow | /promo/extranet/ |
| Disallow | */ads/system/context |
| Allow | *.css* |
| Allow | *.js* |
| Allow | *search_all_days* |
googlebot
| Rule | Path |
|---|---|
| Disallow | /?* |
| Allow | /*?*page= |
| Disallow | /*/search* |
| Disallow | /*/order* |
| Disallow | /*/orders* |
| Disallow | /*/redirect* |
| Disallow | /*when%3D* |
| Disallow | /trains/*/20* |
| Disallow | /hotels/*checkinDate%3D* |
| Disallow | /buses/*date%3D* |
| Disallow | /avia/toCountry/ |
| Disallow | /avia/toAnywhere/ |
| Disallow | */book/* |
| Disallow | */booking/* |
| Disallow | /my* |
| Disallow | /incompatible/ |
| Disallow | /favorites/ |
| Disallow | /redir* |
| Disallow | /gate/ |
| Disallow | /api/ |
| Disallow | /journal/writing/* |
| Allow | /journal/ |
| Disallow | /extranet/ |
| Allow | /promo/extranet/ |
| Disallow | *utm_campaign%3Dblank* |
| Disallow | *utm_source%3Drasp* |
| Disallow | /-/* |
| Disallow | *geoId%3D* |
| Disallow | */ads/system/context |
| Allow | *.css* |
| Allow | *.js* |
| Allow | *search_all_days* |
*
| Rule | Path |
|---|---|
| Disallow | /?* |
| Disallow | /*/search* |
| Disallow | /*/order* |
| Disallow | /*/orders/ |
| Disallow | /*/redirect |
| Disallow | /*when%3D* |
| Disallow | /trains/*/20* |
| Disallow | /hotels/*checkinDate%3D* |
| Disallow | /buses/*date%3D* |
| Disallow | /avia/toCountry/ |
| Disallow | /avia/toAnywhere/ |
| Disallow | */book/* |
| Disallow | */booking/* |
| Disallow | /my* |
| Disallow | /incompatible/ |
| Disallow | /favorites/ |
| Disallow | /redir |
| Disallow | /gate/ |
| Disallow | /api/ |
| Disallow | /journal/writing/* |
| Allow | /journal/ |
| Disallow | /extranet/ |
| Allow | /promo/extranet/ |
| Disallow | */ads/system/context |
| Disallow | /amp/ |
| Allow | *.css* |
| Allow | *.js* |
| Allow | *search_all_days* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://travel.yandex.ru/sitemaps/trains/sitemap.xml.gz |
| sitemap | https://travel.yandex.ru/sitemaps/hotels/sitemap.xml.gz |
| sitemap | https://travel.yandex.ru/sitemaps/buses/sitemap.xml |
| sitemap | https://travel.yandex.ru/sitemaps/avia/sitemap.xml.gz |
| sitemap | https://travel.yandex.ru/journal/sitemap/main.xml.gz |
| sitemap | https://travel.yandex.ru/pro/sitemap/main.xml.gz |
| sitemap | https://travel.yandex.ru/sitemaps/trains/sitemap.xml.gz |
| sitemap | https://travel.yandex.ru/sitemaps/hotels/sitemap.xml.gz |
| sitemap | https://travel.yandex.ru/sitemaps/buses/sitemap.xml |
| sitemap | https://travel.yandex.ru/sitemaps/avia/sitemap.xml.gz |
| sitemap | https://travel.yandex.ru/journal/sitemap/main.xml.gz |
| sitemap | https://travel.yandex.ru/pro/sitemap/main.xml.gz |
| sitemap | https://travel.yandex.ru/sitemaps/trains/sitemap.xml.gz |
| sitemap | https://travel.yandex.ru/sitemaps/hotels/sitemap.xml.gz |
| sitemap | https://travel.yandex.ru/sitemaps/buses/sitemap.xml |
| sitemap | https://travel.yandex.ru/sitemaps/avia/sitemap.xml.gz |
| sitemap | https://travel.yandex.ru/journal/sitemap/main.xml.gz |
| sitemap | https://travel.yandex.ru/pro/sitemap/main.xml.gz |
Warnings
- `clean-param` is not a known field.