yandex.by
robots.txt
Robots Exclusion Standard data for yandex.by
Resource Scan
Scan Details
| Site Domain | yandex.by |
| Base Domain | yandex.by |
| Scan Status | Ok |
| Last Scan | 2024-04-16T19:12:27+00:00 |
| Next Scan | 2024-04-23T19:12:27+00:00 |
Last Scan
| Scanned | 2024-04-16T19:12:27+00:00 |
| URL | https://yandex.by/robots.txt |
| Domain IPs | 2a02:6b8:a::a, 5.255.255.5, 5.255.255.55, 77.88.55.55, 77.88.55.66 |
| Response IP | 5.255.255.5 |
| Found | Yes |
| Hash | eb7981e00dca199a771ffc77eb7ca2887e64b207bc46156054c9d294ccebe907 |
| SimHash | 6da82050e196 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /? |
| Disallow | /403.html |
| Disallow | /404.html |
| Disallow | /500.html |
| Disallow | /about.html |
| Disallow | /adddata |
| Disallow | /adresa-segmentator |
| Disallow | /advanced_engl.html |
| Disallow | /advertising |
| Disallow | /all-supported-params |
| Disallow | /articles |
| Disallow | /blog/punto |
| Disallow | /blogs* |
| Allow | /blogs$ |
| Allow | /blogs/$ |
| Allow | /blogs/pad/$ |
| Allow | /blogs/pad$ |
| Disallow | /catalog/?text= |
| Disallow | /chat |
| Disallow | /cgi-bin/ |
| Disallow | /cgi/ |
| Disallow | /chisla.html |
| Disallow | /clck |
| Disallow | /activity/ |
| Disallow | /collections/feed |
| Disallow | /collections/search/ |
| Disallow | /collections/*/search/* |
| Disallow | /collections/iznanka/ |
| Disallow | /collections/*/_followers* |
| Disallow | /collections/*/_followings* |
| Disallow | /collections/share |
| Disallow | /collections/favorites |
| Disallow | /collections/embed |
| Disallow | /collections/picture/ |
| Disallow | /comments/* |
| Disallow | /pogoda/0 |
| Disallow | /MAPS/ |
| Disallow | /MaPS/ |
| Disallow | /MapS/ |
| Disallow | /Maps/ |
| Disallow | /mApS/ |
| Disallow | /conflagexp |
| Disallow | /cy |
| Disallow | /cycounter |
| Disallow | /dzen |
| Disallow | /edu/ping |
| Disallow | /edu/tasks |
| Disallow | /edu/teachers |
| Disallow | /edu/test |
| Disallow | /efir |
| Disallow | /experiments.xml |
| Disallow | /formfeedback |
| Disallow | /goto_issue/ |
| Disallow | /goto_rubric/ |
| Disallow | /i/ |
| Disallow | /images-data |
| Disallow | /images.html |
| Disallow | /images/* |
| Disallow | /images-apphost/* |
| Allow | /images/$ |
| Allow | /images/smart/$ |
| Allow | /images/touch/$ |
| Allow | /images/touch/? |
| Disallow | /index_m |
| Disallow | /infected |
| Disallow | /iznanka/ |
| Allow | /health/ |
| Disallow | /keyboard_qwerty.html |
| Disallow | /logotypes |
| Disallow | /local/ |
| Disallow | /more_samples |
| Disallow | /msearch |
| Disallow | /msearchpart |
| Disallow | /maps/print/* |
| Allow | /maps/*?lang=kk$ |
| Allow | /maps/*?lang=uz$ |
| Disallow | /metro/*?from |
| Disallow | /norobot |
| Disallow | /opensearch.xml |
| Disallow | /padsearch |
| Disallow | /people/* |
| Allow | /people$ |
| Allow | /people/$ |
| Allow | /people/pad/$ |
| Allow | /people/pad$ |
| Disallow | /person |
| Disallow | /podpiska/login.pl |
| Disallow | /pogoda/search |
| Disallow | /pogoda/404 |
| Disallow | /pogoda/*?*lat=*&*lon=* |
| Disallow | /pogoda/*?*lon=*&*lat=* |
| Disallow | /polling |
| Disallow | /promo/*goodbye* |
| Disallow | /promo/diskelement |
| Disallow | /promo/launcher/mgoodbye/* |
| Disallow | /promo/skype*?* |
| Disallow | /promo/skype/*/* |
| Disallow | /promo/*welcome* |
| Disallow | /promo/yobject/changelog* |
| Disallow | /safety/?* |
| Disallow | /soft/bm/goodbye |
| Disallow | /soft/chrome/ext-install/* |
| Disallow | /soft/chrome/searchline-install/* |
| Disallow | /soft/*goodbye* |
| Disallow | /soft/punto/mac/uninstall/* |
| Disallow | /soft/punto/win/uninstall/* |
| Disallow | /soft/*welcome* |
| Disallow | /soft/win/?* |
| Disallow | /quotes |
| Disallow | /redir |
| Disallow | /region_map |
| Disallow | /regions_list.xml |
| Disallow | /regions.html? |
| Disallow | /rubric2sport |
| Disallow | /s/ |
| Disallow | /save |
| Disallow | /search |
| Disallow | /setup |
| Disallow | /showcaptcha |
| Disallow | /sitesearch |
| Disallow | /skazki |
| Disallow | /sl/*.html |
| Disallow | /soft/extensions/goodbye |
| Disallow | /sportagent |
| Disallow | /storeclick |
| Disallow | /storerequest |
| Disallow | /subscribe/confirm.pl |
| Disallow | /subscribe/view.pl |
| Allow | /support/ |
| Disallow | /support/direct-images |
| Disallow | /support/direct-tooltips |
| Disallow | /support/distr |
| Disallow | /support/dsp |
| Disallow | /support/fe4be44a295cc679e19bf0b8f133083d |
| Disallow | /support/maps-beta |
| Disallow | /support/market-images |
| Disallow | /support/security |
| Disallow | /support/webmaster-images |
| Disallow | /support/*zout_ |
| Disallow | /support/praktikum/flow.html |
| Disallow | /support/praktikum-english/ |
| Disallow | /telsearch |
| Disallow | /themes |
| Disallow | /toggle-experiment |
| Disallow | /touchsearch |
| Disallow | /tune*retpath%3D |
| Disallow | /v$ |
| Disallow | /viewconfig$ |
| Disallow | /video/v$ |
| Disallow | /video/viewconfig$ |
| Disallow | /images/v$ |
| Disallow | /images/viewconfig$ |
| Allow | /uslugi/$ |
| Disallow | /uslugi/* |
| Allow | /tutor |
| Disallow | /tutor/admin |
| Disallow | /tutor/search/problems |
| Disallow | /versions |
| Disallow | /video/* |
| Disallow | /video/*filmId%3D* |
| Disallow | /video/search |
| Disallow | /video/preview |
| Disallow | /video/*/search |
| Disallow | /video/*/preview |
| Allow | /video/$ |
| Allow | /video/? |
| Allow | /video/dizi-izle/ |
| Allow | /video/dizi-izle/? |
| Allow | /video/yerli-dizi-izle/ |
| Allow | /video/yabanci-dizi-izle/ |
| Allow | /video/touch/ |
| Allow | /video/pad/ |
| Disallow | /xmlsearch |
| Disallow | /yaca |
| Allow | /yaca/$ |
| Allow | /yaca/m/$ |
| Allow | /yaca/m/yca/cat/*/$ |
| Allow | /yaca/*.xml$ |
| Allow | /yaca/cat/*/$ |
| Disallow | /yaca/result.xml |
| Disallow | /yaca/*/tungrp/ |
| Disallow | /yaca/*/time/ |
| Disallow | /yaca/*/geo/ |
| Disallow | /yaca/cat/*/geo/* |
| Disallow | /yaca/*/synt2/ |
| Disallow | /yandsearch |
| Disallow | /yca/cy |
| Allow | /yac2014 |
| Disallow | /soft/distribution |
| Disallow | /soft/?* |
| Disallow | /promo/launcher/?* |
| Disallow | /opera/?* |
| Disallow | /firefox/?* |
| Disallow | /soft/bm/?* |
| Disallow | /soft/browsers/?* |
| Disallow | /soft/punto/?* |
| Disallow | /ie/?* |
| Disallow | /element/?* |
| Disallow | /element/*goodbye* |
| Disallow | /soft/*goodbye* |
| Disallow | /adult |
| Disallow | /sport*?*parent-reqid* |
| Disallow | /mirror*?*parent-reqid* |
| Disallow | /turbo*?*parent-reqid* |
| Disallow | /mirror/hide |
| Disallow | /turbo*?*ajax=1* |
| Disallow | /sport*?*ajax=1* |
| Disallow | /mirror*?*ajax=1* |
| Disallow | /games/*?*reqId* |
| Disallow | /games/*?*pageId* |
| Disallow | *maps/covid19* |
| Disallow | /support2/*zout_ |
| Disallow | /sport |
| Disallow | /support2/sport* |
| Disallow | /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/* |
| Disallow | /video/touch/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/* |
yandex
| Rule | Path |
|---|---|
| Disallow | /? |
| Disallow | /403.html |
| Disallow | /404.html |
| Disallow | /500.html |
| Disallow | /about.html |
| Disallow | /adddata |
| Disallow | /adresa-segmentator |
| Disallow | /advanced_engl.html |
| Disallow | /advertising |
| Disallow | /all-supported-params |
| Disallow | /articles |
| Disallow | /blog/punto |
| Disallow | /blogs* |
| Allow | /blogs$ |
| Allow | /blogs/$ |
| Allow | /blogs/pad/$ |
| Allow | /blogs/pad$ |
| Disallow | /catalog/?text= |
| Disallow | /chat |
| Disallow | /cgi-bin/ |
| Disallow | /cgi/ |
| Disallow | /chisla.html |
| Disallow | /clck |
| Disallow | /activity/ |
| Disallow | /collections/feed |
| Disallow | /collections/search/ |
| Disallow | /collections/*/search/* |
| Disallow | /collections/iznanka/ |
| Disallow | /collections/*/_followers* |
| Disallow | /collections/*/_followings* |
| Disallow | /collections/share |
| Disallow | /collections/favorites |
| Disallow | /collections/embed |
| Disallow | /collections/picture/ |
| Disallow | /comments/* |
| Disallow | /MAPS/ |
| Disallow | /MaPS/ |
| Disallow | /MapS/ |
| Disallow | /Maps/ |
| Disallow | /mApS/ |
| Disallow | /conflagexp |
| Disallow | /cy |
| Disallow | /cycounter |
| Disallow | /dzen |
| Disallow | /edu/ping |
| Disallow | /edu/tasks |
| Disallow | /edu/teachers |
| Disallow | /edu/test |
| Disallow | /efir |
| Disallow | /experiments.xml |
| Disallow | /formfeedback |
| Disallow | /goto_issue/ |
| Disallow | /goto_rubric/ |
| Disallow | /i/ |
| Disallow | /images-data |
| Disallow | /images.html |
| Disallow | /images/* |
| Disallow | /images-apphost/* |
| Allow | /images/$ |
| Allow | /images/smart/$ |
| Allow | /images/touch/$ |
| Allow | /images/touch/? |
| Disallow | /index_m |
| Disallow | /infected |
| Disallow | /iznanka/ |
| Allow | /health/ |
| Disallow | /keyboard_qwerty.html |
| Disallow | /logotypes |
| Disallow | /local/ |
| Disallow | /more_samples |
| Disallow | /msearch |
| Disallow | /msearchpart |
| Disallow | /maps/print/* |
| Allow | /maps/*?lang=kk$ |
| Allow | /maps/*?lang=uz$ |
| Disallow | /metro/*?from |
| Disallow | /norobot |
| Disallow | /opensearch.xml |
| Disallow | /padsearch |
| Disallow | /people/* |
| Allow | /people$ |
| Allow | /people/$ |
| Allow | /people/pad/$ |
| Allow | /people/pad$ |
| Disallow | /person |
| Disallow | /podpiska/login.pl |
| Disallow | /pogoda/search |
| Disallow | /pogoda/0 |
| Disallow | /pogoda/404 |
| Disallow | /pogoda/*?*lat=*&*lon=* |
| Disallow | /pogoda/*?*lon=*&*lat=* |
| Disallow | /polling |
| Disallow | /promo/*goodbye* |
| Disallow | /promo/diskelement |
| Disallow | /promo/launcher/mgoodbye/* |
| Disallow | /promo/skype*?* |
| Disallow | /promo/skype/*/* |
| Disallow | /promo/*welcome* |
| Disallow | /promo/yobject/changelog* |
| Disallow | /safety/?* |
| Disallow | /soft/bm/goodbye |
| Disallow | /soft/chrome/ext-install/* |
| Disallow | /soft/chrome/searchline-install/* |
| Disallow | /soft/*goodbye* |
| Disallow | /soft/punto/mac/uninstall/* |
| Disallow | /soft/punto/win/uninstall/* |
| Disallow | /soft/*welcome* |
| Disallow | /soft/win/?* |
| Disallow | /quotes |
| Disallow | /redir |
| Disallow | /region_map |
| Disallow | /regions_list.xml |
| Disallow | /regions.html? |
| Disallow | /rubric2sport |
| Disallow | /s/ |
| Disallow | /save |
| Disallow | /search |
| Disallow | /setup |
| Disallow | /showcaptcha |
| Disallow | /sitesearch |
| Disallow | /skazki |
| Disallow | /sl/*.html |
| Disallow | /soft/extensions/goodbye |
| Disallow | /sportagent |
| Disallow | /storeclick |
| Disallow | /storerequest |
| Disallow | /subscribe/confirm.pl |
| Disallow | /subscribe/view.pl |
| Allow | /support/ |
| Disallow | /support/direct-images |
| Disallow | /support/direct-tooltips |
| Disallow | /support/distr |
| Disallow | /support/dsp |
| Disallow | /support/fe4be44a295cc679e19bf0b8f133083d |
| Disallow | /support/maps-beta |
| Disallow | /support/market-images |
| Disallow | /support/security |
| Disallow | /support/webmaster-images |
| Disallow | /support/*zout_ |
| Disallow | /support/praktikum/flow.html |
| Disallow | /support/praktikum-english/ |
| Disallow | /telsearch |
| Disallow | /themes |
| Disallow | /toggle-experiment |
| Disallow | /touchsearch |
| Disallow | /tune*retpath%3D |
| Disallow | /v$ |
| Disallow | /viewconfig$ |
| Disallow | /video/v$ |
| Disallow | /video/viewconfig$ |
| Disallow | /images/v$ |
| Disallow | /images/viewconfig$ |
| Allow | /uslugi/$ |
| Disallow | /uslugi/* |
| Allow | /tutor |
| Disallow | /tutor/admin |
| Disallow | /tutor/search/problems |
| Disallow | /versions |
| Disallow | /video/* |
| Disallow | /video/*filmId%3D* |
| Disallow | /video/search |
| Disallow | /video/preview |
| Disallow | /video/*/search |
| Disallow | /video/*/preview |
| Disallow | /video/touch |
| Allow | /video/$ |
| Allow | /video/? |
| Allow | /video/dizi-izle/ |
| Allow | /video/dizi-izle/? |
| Allow | /video/yerli-dizi-izle/ |
| Allow | /video/yabanci-dizi-izle/ |
| Allow | /video/pad/ |
| Disallow | /xmlsearch |
| Disallow | /yaca |
| Allow | /yaca/$ |
| Allow | /yaca/m/$ |
| Allow | /yaca/m/yca/cat/*/$ |
| Allow | /yaca/*.xml$ |
| Allow | /yaca/cat/*/$ |
| Disallow | /yaca/result.xml |
| Disallow | /yaca/*/tungrp/ |
| Disallow | /yaca/*/time/ |
| Disallow | /yaca/*/geo/ |
| Disallow | /yaca/cat/*/geo/* |
| Disallow | /yaca/*/synt2/ |
| Disallow | /yandsearch |
| Disallow | /yca/cy |
| Allow | /yac2014 |
| Disallow | /soft/distribution |
| Disallow | /soft/?* |
| Disallow | /promo/launcher/?* |
| Disallow | /opera/?* |
| Disallow | /firefox/?* |
| Disallow | /soft/bm/?* |
| Disallow | /soft/browsers/?* |
| Disallow | /soft/punto/?* |
| Disallow | /ie/?* |
| Disallow | /element/?* |
| Disallow | /element/*goodbye* |
| Disallow | /soft/*goodbye* |
| Disallow | /adult |
| Disallow | /sport*?*parent-reqid* |
| Disallow | /mirror*?*parent-reqid* |
| Disallow | /turbo*?*parent-reqid* |
| Disallow | /mirror/hide |
| Disallow | /turbo*?*ajax=1* |
| Disallow | /sport*?*ajax=1* |
| Disallow | /mirror*?*ajax=1* |
| Disallow | *maps/covid19* |
| Disallow | /support2/*zout_ |
| Disallow | /sport |
| Disallow | /support2/sport* |
| Disallow | /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/* |
| Disallow | /video/touch/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/* |
twitterbot
| Rule | Path |
|---|---|
| Allow | /images |
| Allow | /gorsel |
| Allow | /video |
| Allow | /collections/picture/ |
| Disallow | /adult |
| Disallow | /activity/ |
| Disallow | /comments/* |
| Disallow | /games/*?*reqId* |
| Disallow | /games/*?*pageId* |
| Disallow | *maps/covid19* |
| Disallow | /support2/*zout_ |
| Disallow | /sport |
| Disallow | /support2/sport* |
| Disallow | /video/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/* |
| Disallow | /video/touch/%D0%B7%D0%B0%D0%BF%D1%80%D0%BE%D1%81/* |
Other Records
| Field | Value |
|---|---|
| sitemap | https://yandex.by/pogoda/sitemap_index.xml |
| sitemap | https://yandex.by/support/sitemap.xml |
| sitemap | https://frontend.s3.yandex.net/health/sitemap.xml |
| sitemap | https://yandex.ru/tutor/sitemap/?sitemap=sitemap.xml |
| sitemap | https://yandex.by/games/sitemaps/sitemap.index.xml |
Warnings
- `clean-param` is not a known field.
Comments