languagecoursefinder.com
robots.txt

Robots Exclusion Standard data for languagecoursefinder.com

Resource Scan

Scan Details

Site Domain languagecoursefinder.com
Base Domain languagecoursefinder.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-04-27T21:32:30+00:00
Next Scan 2025-07-26T21:32:30+00:00

Last Successful Scan

Scanned2024-12-06T21:30:45+00:00
URL https://languagecoursefinder.com/robots.txt
Domain IPs 81.177.167.19
Response IP 81.177.167.19
Found Yes
Hash 51d24e6f3fc06c565c46fc8d16167fb5acf3f99bb1c55c3f7fd9f1b2c2a3d9e4
SimHash c74e1fec2688

Groups

yandex

Rule Path
Disallow /russia/*
Disallow /en/russia/*
Disallow /*/*/group/*
Disallow /en/*/*/group/*

googlebot

Rule Path
Disallow /abakan/*/course/*
Disallow /abakan/*/group/*
Disallow /abakan$
Disallow /abingdon$
Disallow /achinsk/*/course/*
Disallow /achinsk/*/group/*
Disallow /achinsk$
Disallow /alicante$
Disallow /almaty$
Disallow /almetyevsk/*/course/*
Disallow /almetyevsk/*/group/*
Disallow /almetyevsk$
Disallow /angarsk/*/course/*
Disallow /angarsk/*/group/*
Disallow /angarsk$
Disallow /arkhangelsk/*/course/*
Disallow /arkhangelsk/*/group/*
Disallow /arkhangelsk$
Disallow /armavir/*/course/*
Disallow /armavir/*/group/*
Disallow /armavir$
Disallow /artyom/*/course/*
Disallow /artyom/*/group/*
Disallow /artyom$
Disallow /arundel$
Disallow /arzamas/*/course/*
Disallow /arzamas/*/group/*
Disallow /arzamas$
Disallow /astana$
Disallow /astrakhan/*/course/*
Disallow /astrakhan/*/group/*
Disallow /astrakhan$
Disallow /balakovo/*/course/*
Disallow /balakovo/*/group/*
Disallow /balakovo$
Disallow /balashikha/*/course/*
Disallow /balashikha/*/group/*
Disallow /balashikha$
Disallow /banbury$
Disallow /baranavichy$
Disallow /barcelona$
Disallow /barnaul/*/course/*
Disallow /barnaul/*/group/*
Disallow /barnaul$
Disallow /bataysk/*/course/*
Disallow /bataysk/*/group/*
Disallow /bataysk$
Disallow /bath$
Disallow /belgorod/*/course/*
Disallow /belgorod/*/group/*
Disallow /berdsk/*/course/*
Disallow /berdsk/*/group/*
Disallow /berdsk$
Disallow /berezniki/*/course/*
Disallow /berezniki/*/group/*
Disallow /berezniki$
Disallow /berkeley$
Disallow /biysk/*/course/*
Disallow /biysk/*/group/*
Disallow /biysk$
Disallow /blagoveshchensk/*/course/*
Disallow /blagoveshchensk/*/group/*
Disallow /blagoveshchensk$
Disallow /blandford-forum$
Disallow /bobruisk$
Disallow /borisov$
Disallow /boston$
Disallow /bournemouth$
Disallow /bradfield$
Disallow /bratsk/*/course/*
Disallow /bratsk/*/group/*
Disallow /bratsk$
Disallow /bray$
Disallow /brest$
Disallow /brighton$
Disallow /bristol$
Disallow /bromsgrove$
Disallow /brooklyn$
Disallow /bryansk/*/course/*
Disallow /bryansk/*/group/*
Disallow /bryansk$
Disallow /buckingham$
Disallow /bundoran$
Disallow /cambridge$
Disallow /canterbury$
Disallow /cheboksary/*/course/*
Disallow /cheboksary/*/group/*
Disallow /cheboksary$
Disallow /chekhov/*/course/*
Disallow /chekhov/*/group/*
Disallow /chekhov$
Disallow /cheltenham$
Disallow /chelyabinsk/*/course/*
Disallow /chelyabinsk/*/group/*
Disallow /chelyabinsk$
Disallow /cherepovets/*/course/*
Disallow /cherepovets/*/group/*
Disallow /cherepovets$
Disallow /cherkessk/*/course/*
Disallow /cherkessk/*/group/*
Disallow /cherkessk$
Disallow /chichester$
Disallow /chislehurst$
Disallow /chita/*/course/*
Disallow /chita/*/group/*
Disallow /cork$
Disallow /crowthorne$
Disallow /derbent/*/course/*
Disallow /derbent/*/group/*
Disallow /derbent$
Disallow /dimitrovgrad/*/course/*
Disallow /dimitrovgrad/*/group/*
Disallow /dimitrovgrad$
Disallow /dolgoprudny/*/course/*
Disallow /dolgoprudny/*/group/*
Disallow /dolgoprudny$
Disallow /domodedovo/*/course/*
Disallow /domodedovo/*/group/*
Disallow /domodedovo$
Disallow /dublin$
Disallow /dzerzhinsk/*/course/*
Disallow /dzerzhinsk/*/group/*
Disallow /dzerzhinsk$
Disallow /elektrostal/*/course/*
Disallow /elektrostal/*/group/*
Disallow /elektrostal$
Disallow /elista/*/course/*
Disallow /elista/*/group/*
Disallow /elista$
Disallow /ellesmere$
Disallow /engels/*/course/*
Disallow /engels/*/group/*
Disallow /engels$
Disallow /ennis$
Disallow /folkestone$
Disallow /frankfurt-am-main$
Disallow /galway$
Disallow /godalming$
Disallow /granada$
Disallow /gravesend$
Disallow /grozny/*/course/*
Disallow /grozny/*/group/*
Disallow /grozny$
Disallow /hallandale-beach$
Disallow /hatfield$
Disallow /high-wycombe$
Disallow /irkutsk/*/course/*
Disallow /irkutsk/*/group/*
Disallow /ivanovo/*/course/*
Disallow /ivanovo/*/group/*
Disallow /ivanovo$
Disallow /izhevsk/*/course/*
Disallow /izhevsk/*/group/*
Disallow /izhevsk$
Disallow /kaliningrad/*/course/*
Disallow /kaliningrad/*/group/*
Disallow /kaluga/*/course/*
Disallow /kaluga/*/group/*
Disallow /kaluga$
Disallow /kamensk-uralsky/*/course/*
Disallow /kamensk-uralsky/*/group/*
Disallow /kamensk-uralsky$
Disallow /kamyshin/*/course/*
Disallow /kamyshin/*/group/*
Disallow /kamyshin$
Disallow /karaganda$
Disallow /kaspiysk/*/course/*
Disallow /kaspiysk/*/group/*
Disallow /kaspiysk$
Disallow /kazan/*/course/*
Disallow /kazan/*/group/*
Disallow /keln$
Disallow /kemerovo/*/course/*
Disallow /kemerovo/*/group/*
Disallow /kemerovo$
Disallow /kerch$
Disallow /khabarovsk/*/course/*
Disallow /khabarovsk/*/group/*
Disallow /khabarovsk$
Disallow /khanty-mansiysk/*/course/*
Disallow /khanty-mansiysk/*/group/*
Disallow /khanty-mansiysk$
Disallow /khasavyurt/*/course/*
Disallow /khasavyurt/*/group/*
Disallow /khasavyurt$
Disallow /khimki/*/course/*
Disallow /khimki/*/group/*
Disallow /khimki$
Disallow /kingston-upon-thames$
Disallow /kirov/*/course/*
Disallow /kirov/*/group/*
Disallow /kirov$
Disallow /kislovodsk/*/course/*
Disallow /kislovodsk/*/group/*
Disallow /kislovodsk$
Disallow /kobrin$
Disallow /kolomna/*/course/*
Disallow /kolomna/*/group/*
Disallow /kolomna$
Disallow /komsomolsk-on-amur/*/course/*
Disallow /komsomolsk-on-amur/*/group/*
Disallow /komsomolsk-on-amur$
Disallow /kopeysk/*/course/*
Disallow /kopeysk/*/group/*
Disallow /kopeysk$
Disallow /korolyov/*/course/*
Disallow /korolyov/*/group/*
Disallow /korolyov$
Disallow /kostanay$
Disallow /kostroma/*/course/*
Disallow /kostroma/*/group/*
Disallow /kovrov/*/course/*
Disallow /kovrov/*/group/*
Disallow /kovrov$
Disallow /krasnodar/*/course/*
Disallow /krasnodar/*/group/*
Disallow /krasnogorsk/*/course/*
Disallow /krasnogorsk/*/group/*
Disallow /krasnogorsk$
Disallow /krasnoyarsk/*/course/*
Disallow /krasnoyarsk/*/group/*
Disallow /krasnoyarsk$
Disallow /kurgan/*/course/*
Disallow /kurgan/*/group/*
Disallow /kurgan$
Disallow /kursk/*/course/*
Disallow /kursk/*/group/*
Disallow /kyzyl/*/course/*
Disallow /kyzyl/*/group/*
Disallow /kyzyl$
Disallow /ladysmith$
Disallow /lesosibirsk/*/course/*
Disallow /lesosibirsk/*/group/*
Disallow /lesosibirsk$
Disallow /lida$
Disallow /limerick$
Disallow /lipetsk/*/course/*
Disallow /lipetsk/*/group/*
Disallow /lipetsk$
Disallow /lobnya/*/course/*
Disallow /lobnya/*/group/*
Disallow /lobnya$
Disallow /london$
Disallow /los-angeles$
Disallow /lyubertsy/*/course/*
Disallow /lyubertsy/*/group/*
Disallow /lyubertsy$
Disallow /madrid$
Disallow /magnitogorsk/*/course/*
Disallow /magnitogorsk/*/group/*
Disallow /magnitogorsk$
Disallow /makhachkala/*/course/*
Disallow /makhachkala/*/group/*
Disallow /malaga$
Disallow /malahide$
Disallow /marbella$
Disallow /marsaskala$
Disallow /maykop/*/course/*
Disallow /maykop/*/group/*
Disallow /maykop$
Disallow /miass/*/course/*
Disallow /miass/*/group/*
Disallow /miass$
Disallow /mogilev$
Disallow /moscow/*/course/*
Disallow /moscow/*/group/*
Disallow /mosta$
Disallow /mozyr$
Disallow /msida$
Disallow /murmansk/*/course/*
Disallow /murmansk/*/group/*
Disallow /murom/*/course/*
Disallow /murom/*/group/*
Disallow /murom$
Disallow /mytishchi/*/course/*
Disallow /mytishchi/*/group/*
Disallow /mytishchi$
Disallow /naberezhnye-chelny/*/course/*
Disallow /naberezhnye-chelny/*/group/*
Disallow /naberezhnye-chelny$
Disallow /nakhodka/*/course/*
Disallow /nakhodka/*/group/*
Disallow /nakhodka$
Disallow /nalchik/*/course/*
Disallow /nalchik/*/group/*
Disallow /nalchik$
Disallow /nazran/*/course/*
Disallow /nazran/*/group/*
Disallow /nazran$
Disallow /neftekamsk/*/course/*
Disallow /neftekamsk/*/group/*
Disallow /neftekamsk$
Disallow /nefteyugansk/*/course/*
Disallow /nefteyugansk/*/group/*
Disallow /nefteyugansk$
Disallow /nevinnomyssk/*/course/*
Disallow /nevinnomyssk/*/group/*
Disallow /nevinnomyssk$
Disallow /new-york$
Disallow /newbury$
Disallow /nizhnekamsk/*/course/*
Disallow /nizhnekamsk/*/group/*
Disallow /nizhnekamsk$
Disallow /nizhnevartovsk/*/course/*
Disallow /nizhnevartovsk/*/group/*
Disallow /nizhnevartovsk$
Disallow /nizhny-novgorod/*/course/*
Disallow /nizhny-novgorod/*/group/*
Disallow /nizhny-novgorod$
Disallow /nizhny-tagil/*/course/*
Disallow /nizhny-tagil/*/group/*
Disallow /nizhny-tagil$
Disallow /noginsk/*/course/*
Disallow /noginsk/*/group/*
Disallow /noginsk$
Disallow /norilsk/*/course/*
Disallow /norilsk/*/group/*
Disallow /norilsk$
Disallow /novgorod/*/course/*
Disallow /novgorod/*/group/*
Disallow /novgorod$
Disallow /novocheboksarsk/*/course/*
Disallow /novocheboksarsk/*/group/*
Disallow /novocheboksarsk$
Disallow /novocherkassk/*/course/*
Disallow /novocherkassk/*/group/*
Disallow /novocherkassk$
Disallow /novokuybyshevsk/*/course/*
Disallow /novokuybyshevsk/*/group/*
Disallow /novokuybyshevsk$
Disallow /novokuznetsk/*/course/*
Disallow /novokuznetsk/*/group/*
Disallow /novokuznetsk$
Disallow /novomoskovsk/*/course/*
Disallow /novomoskovsk/*/group/*
Disallow /novomoskovsk$
Disallow /novopolotsk$
Disallow /novorossiysk/*/course/*
Disallow /novorossiysk/*/group/*
Disallow /novorossiysk$
Disallow /novoshakhtinsk/*/course/*
Disallow /novoshakhtinsk/*/group/*
Disallow /novoshakhtinsk$
Disallow /novosibirsk/*/course/*
Disallow /novosibirsk/*/group/*
Disallow /novy-urengoy/*/course/*
Disallow /novy-urengoy/*/group/*
Disallow /novy-urengoy$
Disallow /noyabrsk/*/course/*
Disallow /noyabrsk/*/group/*
Disallow /noyabrsk$
Disallow /obninsk/*/course/*
Disallow /obninsk/*/group/*
Disallow /obninsk$
Disallow /odintsovo/*/course/*
Disallow /odintsovo/*/group/*
Disallow /odintsovo$
Disallow /oktyabrsky/*/course/*
Disallow /oktyabrsky/*/group/*
Disallow /oktyabrsky$
Disallow /omsk/*/course/*
Disallow /omsk/*/group/*
Disallow /omsk$
Disallow /online/*/course/*
Disallow /online/*/group/*
Disallow /online-belarus$
Disallow /orekhovo-zuyevo/*/course/*
Disallow /orekhovo-zuyevo/*/group/*
Disallow /orekhovo-zuyevo$
Disallow /orenburg/*/course/*
Disallow /orenburg/*/group/*
Disallow /orenburg$
Disallow /orsk/*/course/*
Disallow /orsk/*/group/*
Disallow /orsk$
Disallow /oryol/*/course/*
Disallow /oryol/*/group/*
Disallow /oryol$
Disallow /oxford$
Disallow /paignton$
Disallow /penza/*/course/*
Disallow /penza/*/group/*
Disallow /penza$
Disallow /perm/*/course/*
Disallow /perm/*/group/*
Disallow /perm$
Disallow /pervouralsk/*/course/*
Disallow /pervouralsk/*/group/*
Disallow /pervouralsk$
Disallow /petropavlovsk-kamchatsky/*/course/*
Disallow /petropavlovsk-kamchatsky/*/group/*
Disallow /petropavlovsk-kamchatsky$
Disallow /petrozavodsk/*/course/*
Disallow /petrozavodsk/*/group/*
Disallow /plymouth$
Disallow /podolsk/*/course/*
Disallow /podolsk/*/group/*
Disallow /podolsk$
Disallow /polotsk$
Disallow /portsmouth$
Disallow /prague$
Disallow /prokopyevsk/*/course/*
Disallow /prokopyevsk/*/group/*
Disallow /prokopyevsk$
Disallow /pskov/*/course/*
Disallow /pskov/*/group/*
Disallow /pskov$
Disallow /pushkino/*/course/*
Disallow /pushkino/*/group/*
Disallow /pushkino$
Disallow /pyatigorsk/*/course/*
Disallow /pyatigorsk/*/group/*
Disallow /pyatigorsk$
Disallow /ramenskoye/*/course/*
Disallow /ramenskoye/*/group/*
Disallow /ramenskoye$
Disallow /reading$
Disallow /reutov/*/course/*
Disallow /reutov/*/group/*
Disallow /reutov$
Disallow /rogachev$
Disallow /rostov-na-donu/*/course/*
Disallow /rostov-na-donu/*/group/*
Disallow /rostov-na-donu$
Disallow /rubtsovsk/*/course/*
Disallow /rubtsovsk/*/group/*
Disallow /rubtsovsk$
Disallow /ryazan/*/course/*
Disallow /ryazan/*/group/*
Disallow /ryazan$
Disallow /rybinsk/*/course/*
Disallow /rybinsk/*/group/*
Disallow /rybinsk$
Disallow /saint-petersburg/*/course/*
Disallow /saint-petersburg/*/group/*
Disallow /salamanca$
Disallow /salavat/*/course/*
Disallow /salavat/*/group/*
Disallow /salavat$
Disallow /samara/*/course/*
Disallow /samara/*/group/*
Disallow /samara$
Disallow /san-diego$
Disallow /san-francisco$
Disallow /san-gwann$
Disallow /san-sebastian$
Disallow /santa-barbara$
Disallow /santa-cruz-de-tenerife$
Disallow /saratov/*/course/*
Disallow /saratov/*/group/*
Disallow /saratov$
Disallow /schull$
Disallow /sergiyev-posad/*/course/*
Disallow /sergiyev-posad/*/group/*
Disallow /sergiyev-posad$
Disallow /serpukhov/*/course/*
Disallow /serpukhov/*/group/*
Disallow /serpukhov$
Disallow /sevastopol$
Disallow /severodvinsk/*/course/*
Disallow /severodvinsk/*/group/*
Disallow /severodvinsk$
Disallow /seversk/*/course/*
Disallow /seversk/*/group/*
Disallow /seversk$
Disallow /seville$
Disallow /shakhty/*/course/*
Disallow /shakhty/*/group/*
Disallow /shakhty$
Disallow /shchyolkovo/*/course/*
Disallow /shchyolkovo/*/group/*
Disallow /shchyolkovo$
Disallow /sherborne$
Disallow /shrewsbury$
Disallow /simferopol$
Disallow /slonim$
Disallow /smolensk/*/course/*
Disallow /smolensk/*/group/*
Disallow /smolensk$
Disallow /sochi/*/course/*
Disallow /sochi/*/group/*
Disallow /sochi$
Disallow /soligorsk$
Disallow /sosnovoborsk/*/course/*
Disallow /sosnovoborsk/*/group/*
Disallow /sosnovoborsk$
Disallow /st-julians$
Disallow /stary-oskol/*/course/*
Disallow /stary-oskol/*/group/*
Disallow /stary-oskol$
Disallow /stavropol/*/course/*
Disallow /stavropol/*/group/*
Disallow /stavropol$
Disallow /sterlitamak/*/course/*
Disallow /sterlitamak/*/group/*
Disallow /sterlitamak$
Disallow /surgut/*/course/*
Disallow /surgut/*/group/*
Disallow /surgut$
Disallow /svetlogorsk$
Disallow /syktyvkar/*/course/*
Disallow /syktyvkar/*/group/*
Disallow /syktyvkar$
Disallow /syzran/*/course/*
Disallow /syzran/*/group/*
Disallow /syzran$
Disallow /taganrog/*/course/*
Disallow /taganrog/*/group/*
Disallow /taganrog$
Disallow /tambov/*/course/*
Disallow /tambov/*/group/*
Disallow /tambov$
Disallow /tolyatti$
Disallow /tomsk/*/course/*
Disallow /tomsk/*/group/*
Disallow /tomsk$
Disallow /toronto$
Disallow /tula/*/course/*
Disallow /tula/*/group/*
Disallow /tula$
Disallow /tver/*/course/*
Disallow /tver/*/group/*
Disallow /tver$
Disallow /tyumen/*/course/*
Disallow /tyumen/*/group/*
Disallow /ufa/*/course/*
Disallow /ufa/*/group/*
Disallow /ulan-ude/*/course/*
Disallow /ulan-ude/*/group/*
Disallow /ulan-ude$
Disallow /ulyanovsk/*/course/*
Disallow /ulyanovsk/*/group/*
Disallow /ulyanovsk$
Disallow /uppingham$
Disallow /ussuriysk/*/course/*
Disallow /ussuriysk/*/group/*
Disallow /ussuriysk$
Disallow /valencia$
Disallow /valletta$
Disallow /vancouver$
Disallow /verbier$
Disallow /vidnoye/*/course/*
Disallow /vidnoye/*/group/*
Disallow /vidnoye$
Disallow /vladikavkaz/*/course/*
Disallow /vladikavkaz/*/group/*
Disallow /vladikavkaz$
Disallow /vladimir/*/course/*
Disallow /vladimir/*/group/*
Disallow /vladimir$
Disallow /vladivostok/*/course/*
Disallow /vladivostok/*/group/*
Disallow /vladivostok$
Disallow /volgodonsk/*/course/*
Disallow /volgodonsk/*/group/*
Disallow /volgodonsk$
Disallow /volgograd/*/course/*
Disallow /volgograd/*/group/*
Disallow /volgograd$
Disallow /vologda/*/course/*
Disallow /vologda/*/group/*
Disallow /vologda$
Disallow /volzhsky/*/course/*
Disallow /volzhsky/*/group/*
Disallow /volzhsky$
Disallow /voronezh/*/course/*
Disallow /voronezh/*/group/*
Disallow /winchester$
Disallow /woldingham$
Disallow /yakutsk/*/course/*
Disallow /yakutsk/*/group/*
Disallow /yakutsk$
Disallow /yaroslavl/*/course/*
Disallow /yaroslavl/*/group/*
Disallow /yekaterinburg/*/course/*
Disallow /yekaterinburg/*/group/*
Disallow /yelets/*/course/*
Disallow /yelets/*/group/*
Disallow /yelets$
Disallow /yerevan$
Disallow /yessentuki/*/course/*
Disallow /yessentuki/*/group/*
Disallow /yessentuki$
Disallow /yevpatoria$
Disallow /yoshkar-ola/*/course/*
Disallow /yoshkar-ola/*/group/*
Disallow /yoshkar-ola$
Disallow /yuzhno-sakhalinsk/*/course/*
Disallow /yuzhno-sakhalinsk/*/group/*
Disallow /yuzhno-sakhalinsk$
Disallow /zelenogorsk/*/course/*
Disallow /zelenogorsk/*/group/*
Disallow /zelenogorsk$
Disallow /zelenograd/*/course/*
Disallow /zelenograd/*/group/*
Disallow /zelenograd$
Disallow /zheleznogorsk/*/course/*
Disallow /zheleznogorsk/*/group/*
Disallow /zheleznogorsk$
Disallow /zhukovsky/*/course/*
Disallow /zhukovsky/*/group/*
Disallow /zhukovsky$
Disallow /zlatoust/*/course/*
Disallow /zlatoust/*/group/*
Disallow /zlatoust$
Disallow /en/abakan/*/course/*
Disallow /en/abakan/*/group/*
Disallow /en/abakan$
Disallow /en/abingdon$
Disallow /en/achinsk/*/course/*
Disallow /en/achinsk/*/group/*
Disallow /en/achinsk$
Disallow /en/alicante$
Disallow /en/almaty$
Disallow /en/almetyevsk/*/course/*
Disallow /en/almetyevsk/*/group/*
Disallow /en/almetyevsk$
Disallow /en/angarsk/*/course/*
Disallow /en/angarsk/*/group/*
Disallow /en/angarsk$
Disallow /en/arkhangelsk/*/course/*
Disallow /en/arkhangelsk/*/group/*
Disallow /en/arkhangelsk$
Disallow /en/armavir/*/course/*
Disallow /en/armavir/*/group/*
Disallow /en/armavir$
Disallow /en/artyom/*/course/*
Disallow /en/artyom/*/group/*
Disallow /en/artyom$
Disallow /en/arundel$
Disallow /en/arzamas/*/course/*
Disallow /en/arzamas/*/group/*
Disallow /en/arzamas$
Disallow /en/astana$
Disallow /en/astrakhan/*/course/*
Disallow /en/astrakhan/*/group/*
Disallow /en/astrakhan$
Disallow /en/balakovo/*/course/*
Disallow /en/balakovo/*/group/*
Disallow /en/balakovo$
Disallow /en/balashikha/*/course/*
Disallow /en/balashikha/*/group/*
Disallow /en/balashikha$
Disallow /en/banbury$
Disallow /en/baranavichy$
Disallow /en/barcelona$
Disallow /en/barnaul/*/course/*
Disallow /en/barnaul/*/group/*
Disallow /en/barnaul$
Disallow /en/bataysk/*/course/*
Disallow /en/bataysk/*/group/*
Disallow /en/bataysk$
Disallow /en/bath$
Disallow /en/belgorod/*/course/*
Disallow /en/belgorod/*/group/*
Disallow /en/berdsk/*/course/*
Disallow /en/berdsk/*/group/*
Disallow /en/berdsk$
Disallow /en/berezniki/*/course/*
Disallow /en/berezniki/*/group/*
Disallow /en/berezniki$
Disallow /en/berkeley$
Disallow /en/biysk/*/course/*
Disallow /en/biysk/*/group/*
Disallow /en/biysk$
Disallow /en/blagoveshchensk/*/course/*
Disallow /en/blagoveshchensk/*/group/*
Disallow /en/blagoveshchensk$
Disallow /en/blandford-forum$
Disallow /en/bobruisk$
Disallow /en/borisov$
Disallow /en/boston$
Disallow /en/bournemouth$
Disallow /en/bradfield$
Disallow /en/bratsk/*/course/*
Disallow /en/bratsk/*/group/*
Disallow /en/bratsk$
Disallow /en/bray$
Disallow /en/brest$
Disallow /en/brighton$
Disallow /en/bristol$
Disallow /en/bromsgrove$
Disallow /en/brooklyn$
Disallow /en/bryansk/*/course/*
Disallow /en/bryansk/*/group/*
Disallow /en/bryansk$
Disallow /en/buckingham$
Disallow /en/bundoran$
Disallow /en/cambridge$
Disallow /en/canterbury$
Disallow /en/cheboksary/*/course/*
Disallow /en/cheboksary/*/group/*
Disallow /en/cheboksary$
Disallow /en/chekhov/*/course/*
Disallow /en/chekhov/*/group/*
Disallow /en/chekhov$
Disallow /en/cheltenham$
Disallow /en/chelyabinsk/*/course/*
Disallow /en/chelyabinsk/*/group/*
Disallow /en/chelyabinsk$
Disallow /en/cherepovets/*/course/*
Disallow /en/cherepovets/*/group/*
Disallow /en/cherepovets$
Disallow /en/cherkessk/*/course/*
Disallow /en/cherkessk/*/group/*
Disallow /en/cherkessk$
Disallow /en/chichester$
Disallow /en/chislehurst$
Disallow /en/chita/*/course/*
Disallow /en/chita/*/group/*
Disallow /en/cork$
Disallow /en/crowthorne$
Disallow /en/derbent/*/course/*
Disallow /en/derbent/*/group/*
Disallow /en/derbent$
Disallow /en/dimitrovgrad/*/course/*
Disallow /en/dimitrovgrad/*/group/*
Disallow /en/dimitrovgrad$
Disallow /en/dolgoprudny/*/course/*
Disallow /en/dolgoprudny/*/group/*
Disallow /en/dolgoprudny$
Disallow /en/domodedovo/*/course/*
Disallow /en/domodedovo/*/group/*
Disallow /en/domodedovo$
Disallow /en/dublin$
Disallow /en/dzerzhinsk/*/course/*
Disallow /en/dzerzhinsk/*/group/*
Disallow /en/dzerzhinsk$
Disallow /en/elektrostal/*/course/*
Disallow /en/elektrostal/*/group/*
Disallow /en/elektrostal$
Disallow /en/elista/*/course/*
Disallow /en/elista/*/group/*
Disallow /en/elista$
Disallow /en/ellesmere$
Disallow /en/engels/*/course/*
Disallow /en/engels/*/group/*
Disallow /en/engels$
Disallow /en/ennis$
Disallow /en/folkestone$
Disallow /en/frankfurt-am-main$
Disallow /en/galway$
Disallow /en/godalming$
Disallow /en/granada$
Disallow /en/gravesend$
Disallow /en/grozny/*/course/*
Disallow /en/grozny/*/group/*
Disallow /en/grozny$
Disallow /en/hallandale-beach$
Disallow /en/hatfield$
Disallow /en/high-wycombe$
Disallow /en/irkutsk/*/course/*
Disallow /en/irkutsk/*/group/*
Disallow /en/ivanovo/*/course/*
Disallow /en/ivanovo/*/group/*
Disallow /en/ivanovo$
Disallow /en/izhevsk/*/course/*
Disallow /en/izhevsk/*/group/*
Disallow /en/izhevsk$
Disallow /en/kaliningrad/*/course/*
Disallow /en/kaliningrad/*/group/*
Disallow /en/kaluga/*/course/*
Disallow /en/kaluga/*/group/*
Disallow /en/kaluga$
Disallow /en/kamensk-uralsky/*/course/*
Disallow /en/kamensk-uralsky/*/group/*
Disallow /en/kamensk-uralsky$
Disallow /en/kamyshin/*/course/*
Disallow /en/kamyshin/*/group/*
Disallow /en/kamyshin$
Disallow /en/karaganda$
Disallow /en/kaspiysk/*/course/*
Disallow /en/kaspiysk/*/group/*
Disallow /en/kaspiysk$
Disallow /en/kazan/*/course/*
Disallow /en/kazan/*/group/*
Disallow /en/keln$
Disallow /en/kemerovo/*/course/*
Disallow /en/kemerovo/*/group/*
Disallow /en/kemerovo$
Disallow /en/kerch$
Disallow /en/khabarovsk/*/course/*
Disallow /en/khabarovsk/*/group/*
Disallow /en/khabarovsk$
Disallow /en/khanty-mansiysk/*/course/*
Disallow /en/khanty-mansiysk/*/group/*
Disallow /en/khanty-mansiysk$
Disallow /en/khasavyurt/*/course/*
Disallow /en/khasavyurt/*/group/*
Disallow /en/khasavyurt$
Disallow /en/khimki/*/course/*
Disallow /en/khimki/*/group/*
Disallow /en/khimki$
Disallow /en/kingston-upon-thames$
Disallow /en/kirov/*/course/*
Disallow /en/kirov/*/group/*
Disallow /en/kirov$
Disallow /en/kislovodsk/*/course/*
Disallow /en/kislovodsk/*/group/*
Disallow /en/kislovodsk$
Disallow /en/kobrin$
Disallow /en/kolomna/*/course/*
Disallow /en/kolomna/*/group/*
Disallow /en/kolomna$
Disallow /en/komsomolsk-on-amur/*/course/*
Disallow /en/komsomolsk-on-amur/*/group/*
Disallow /en/komsomolsk-on-amur$
Disallow /en/kopeysk/*/course/*
Disallow /en/kopeysk/*/group/*
Disallow /en/kopeysk$
Disallow /en/korolyov/*/course/*
Disallow /en/korolyov/*/group/*
Disallow /en/korolyov$
Disallow /en/kostanay$
Disallow /en/kostroma/*/course/*
Disallow /en/kostroma/*/group/*
Disallow /en/kovrov/*/course/*
Disallow /en/kovrov/*/group/*
Disallow /en/kovrov$
Disallow /en/krasnodar/*/course/*
Disallow /en/krasnodar/*/group/*
Disallow /en/krasnogorsk/*/course/*
Disallow /en/krasnogorsk/*/group/*
Disallow /en/krasnogorsk$
Disallow /en/krasnoyarsk/*/course/*
Disallow /en/krasnoyarsk/*/group/*
Disallow /en/krasnoyarsk$
Disallow /en/kurgan/*/course/*
Disallow /en/kurgan/*/group/*
Disallow /en/kurgan$
Disallow /en/kursk/*/course/*
Disallow /en/kursk/*/group/*
Disallow /en/kyzyl/*/course/*
Disallow /en/kyzyl/*/group/*
Disallow /en/kyzyl$
Disallow /en/ladysmith$
Disallow /en/lesosibirsk/*/course/*
Disallow /en/lesosibirsk/*/group/*
Disallow /en/lesosibirsk$
Disallow /en/lida$
Disallow /en/limerick$
Disallow /en/lipetsk/*/course/*
Disallow /en/lipetsk/*/group/*
Disallow /en/lipetsk$
Disallow /en/lobnya/*/course/*
Disallow /en/lobnya/*/group/*
Disallow /en/lobnya$
Disallow /en/london$
Disallow /en/los-angeles$
Disallow /en/lyubertsy/*/course/*
Disallow /en/lyubertsy/*/group/*
Disallow /en/lyubertsy$
Disallow /en/madrid$
Disallow /en/magnitogorsk/*/course/*
Disallow /en/magnitogorsk/*/group/*
Disallow /en/magnitogorsk$
Disallow /en/makhachkala/*/course/*
Disallow /en/makhachkala/*/group/*
Disallow /en/malaga$
Disallow /en/malahide$
Disallow /en/marbella$
Disallow /en/marsaskala$
Disallow /en/maykop/*/course/*
Disallow /en/maykop/*/group/*
Disallow /en/maykop$
Disallow /en/miass/*/course/*
Disallow /en/miass/*/group/*
Disallow /en/miass$
Disallow /en/mogilev$
Disallow /en/moscow/*/course/*
Disallow /en/moscow/*/group/*
Disallow /en/mosta$
Disallow /en/mozyr$
Disallow /en/msida$
Disallow /en/murmansk/*/course/*
Disallow /en/murmansk/*/group/*
Disallow /en/murom/*/course/*
Disallow /en/murom/*/group/*
Disallow /en/murom$
Disallow /en/mytishchi/*/course/*
Disallow /en/mytishchi/*/group/*
Disallow /en/mytishchi$
Disallow /en/naberezhnye-chelny/*/course/*
Disallow /en/naberezhnye-chelny/*/group/*
Disallow /en/naberezhnye-chelny$
Disallow /en/nakhodka/*/course/*
Disallow /en/nakhodka/*/group/*
Disallow /en/nakhodka$
Disallow /en/nalchik/*/course/*
Disallow /en/nalchik/*/group/*
Disallow /en/nalchik$
Disallow /en/nazran/*/course/*
Disallow /en/nazran/*/group/*
Disallow /en/nazran$
Disallow /en/neftekamsk/*/course/*
Disallow /en/neftekamsk/*/group/*
Disallow /en/neftekamsk$
Disallow /en/nefteyugansk/*/course/*
Disallow /en/nefteyugansk/*/group/*
Disallow /en/nefteyugansk$
Disallow /en/nevinnomyssk/*/course/*
Disallow /en/nevinnomyssk/*/group/*
Disallow /en/nevinnomyssk$
Disallow /en/new-york$
Disallow /en/newbury$
Disallow /en/nizhnekamsk/*/course/*
Disallow /en/nizhnekamsk/*/group/*
Disallow /en/nizhnekamsk$
Disallow /en/nizhnevartovsk/*/course/*
Disallow /en/nizhnevartovsk/*/group/*
Disallow /en/nizhnevartovsk$
Disallow /en/nizhny-novgorod/*/course/*
Disallow /en/nizhny-novgorod/*/group/*
Disallow /en/nizhny-novgorod$
Disallow /en/nizhny-tagil/*/course/*
Disallow /en/nizhny-tagil/*/group/*
Disallow /en/nizhny-tagil$
Disallow /en/noginsk/*/course/*
Disallow /en/noginsk/*/group/*
Disallow /en/noginsk$
Disallow /en/norilsk/*/course/*
Disallow /en/norilsk/*/group/*
Disallow /en/norilsk$
Disallow /en/novgorod/*/course/*
Disallow /en/novgorod/*/group/*
Disallow /en/novgorod$
Disallow /en/novocheboksarsk/*/course/*
Disallow /en/novocheboksarsk/*/group/*
Disallow /en/novocheboksarsk$
Disallow /en/novocherkassk/*/course/*
Disallow /en/novocherkassk/*/group/*
Disallow /en/novocherkassk$
Disallow /en/novokuybyshevsk/*/course/*
Disallow /en/novokuybyshevsk/*/group/*
Disallow /en/novokuybyshevsk$
Disallow /en/novokuznetsk/*/course/*
Disallow /en/novokuznetsk/*/group/*
Disallow /en/novokuznetsk$
Disallow /en/novomoskovsk/*/course/*
Disallow /en/novomoskovsk/*/group/*
Disallow /en/novomoskovsk$
Disallow /en/novopolotsk$
Disallow /en/novorossiysk/*/course/*
Disallow /en/novorossiysk/*/group/*
Disallow /en/novorossiysk$
Disallow /en/novoshakhtinsk/*/course/*
Disallow /en/novoshakhtinsk/*/group/*
Disallow /en/novoshakhtinsk$
Disallow /en/novosibirsk/*/course/*
Disallow /en/novosibirsk/*/group/*
Disallow /en/novy-urengoy/*/course/*
Disallow /en/novy-urengoy/*/group/*
Disallow /en/novy-urengoy$
Disallow /en/noyabrsk/*/course/*
Disallow /en/noyabrsk/*/group/*
Disallow /en/noyabrsk$
Disallow /en/obninsk/*/course/*
Disallow /en/obninsk/*/group/*
Disallow /en/obninsk$
Disallow /en/odintsovo/*/course/*
Disallow /en/odintsovo/*/group/*
Disallow /en/odintsovo$
Disallow /en/oktyabrsky/*/course/*
Disallow /en/oktyabrsky/*/group/*
Disallow /en/oktyabrsky$
Disallow /en/omsk/*/course/*
Disallow /en/omsk/*/group/*
Disallow /en/omsk$
Disallow /en/online/*/course/*
Disallow /en/online/*/group/*
Disallow /en/online-belarus$
Disallow /en/orekhovo-zuyevo/*/course/*
Disallow /en/orekhovo-zuyevo/*/group/*
Disallow /en/orekhovo-zuyevo$
Disallow /en/orenburg/*/course/*
Disallow /en/orenburg/*/group/*
Disallow /en/orenburg$
Disallow /en/orsk/*/course/*
Disallow /en/orsk/*/group/*
Disallow /en/orsk$
Disallow /en/oryol/*/course/*
Disallow /en/oryol/*/group/*
Disallow /en/oryol$
Disallow /en/oxford$
Disallow /en/paignton$
Disallow /en/penza/*/course/*
Disallow /en/penza/*/group/*
Disallow /en/penza$
Disallow /en/perm/*/course/*
Disallow /en/perm/*/group/*
Disallow /en/perm$
Disallow /en/pervouralsk/*/course/*
Disallow /en/pervouralsk/*/group/*
Disallow /en/pervouralsk$
Disallow /en/petropavlovsk-kamchatsky/*/course/*
Disallow /en/petropavlovsk-kamchatsky/*/group/*
Disallow /en/petropavlovsk-kamchatsky$
Disallow /en/petrozavodsk/*/course/*
Disallow /en/petrozavodsk/*/group/*
Disallow /en/plymouth$
Disallow /en/podolsk/*/course/*
Disallow /en/podolsk/*/group/*
Disallow /en/podolsk$
Disallow /en/polotsk$
Disallow /en/portsmouth$
Disallow /en/prague$
Disallow /en/prokopyevsk/*/course/*
Disallow /en/prokopyevsk/*/group/*
Disallow /en/prokopyevsk$
Disallow /en/pskov/*/course/*
Disallow /en/pskov/*/group/*
Disallow /en/pskov$
Disallow /en/pushkino/*/course/*
Disallow /en/pushkino/*/group/*
Disallow /en/pushkino$
Disallow /en/pyatigorsk/*/course/*
Disallow /en/pyatigorsk/*/group/*
Disallow /en/pyatigorsk$
Disallow /en/ramenskoye/*/course/*
Disallow /en/ramenskoye/*/group/*
Disallow /en/ramenskoye$
Disallow /en/reading$
Disallow /en/reutov/*/course/*
Disallow /en/reutov/*/group/*
Disallow /en/reutov$
Disallow /en/rogachev$
Disallow /en/rostov-na-donu/*/course/*
Disallow /en/rostov-na-donu/*/group/*
Disallow /en/rostov-na-donu$
Disallow /en/rubtsovsk/*/course/*
Disallow /en/rubtsovsk/*/group/*
Disallow /en/rubtsovsk$
Disallow /en/ryazan/*/course/*
Disallow /en/ryazan/*/group/*
Disallow /en/ryazan$
Disallow /en/rybinsk/*/course/*
Disallow /en/rybinsk/*/group/*
Disallow /en/rybinsk$
Disallow /en/saint-petersburg/*/course/*
Disallow /en/saint-petersburg/*/group/*
Disallow /en/salamanca$
Disallow /en/salavat/*/course/*
Disallow /en/salavat/*/group/*
Disallow /en/salavat$
Disallow /en/samara/*/course/*
Disallow /en/samara/*/group/*
Disallow /en/samara$
Disallow /en/san-diego$
Disallow /en/san-francisco$
Disallow /en/san-gwann$
Disallow /en/san-sebastian$
Disallow /en/santa-barbara$
Disallow /en/santa-cruz-de-tenerife$
Disallow /en/saransk/*/course/*
Disallow /en/saransk/*/group/*
Disallow /en/saratov/*/course/*
Disallow /en/saratov/*/group/*
Disallow /en/saratov$
Disallow /en/schull$
Disallow /en/sergiyev-posad/*/course/*
Disallow /en/sergiyev-posad/*/group/*
Disallow /en/sergiyev-posad$
Disallow /en/serpukhov/*/course/*
Disallow /en/serpukhov/*/group/*
Disallow /en/serpukhov$
Disallow /en/sevastopol$
Disallow /en/severodvinsk/*/course/*
Disallow /en/severodvinsk/*/group/*
Disallow /en/severodvinsk$
Disallow /en/seversk/*/course/*
Disallow /en/seversk/*/group/*
Disallow /en/seversk$
Disallow /en/seville$
Disallow /en/shakhty/*/course/*
Disallow /en/shakhty/*/group/*
Disallow /en/shakhty$
Disallow /en/shchyolkovo/*/course/*
Disallow /en/shchyolkovo/*/group/*
Disallow /en/shchyolkovo$
Disallow /en/sherborne$
Disallow /en/shrewsbury$
Disallow /en/simferopol$
Disallow /en/slonim$
Disallow /en/smolensk/*/course/*
Disallow /en/smolensk/*/group/*
Disallow /en/smolensk$
Disallow /en/sochi/*/course/*
Disallow /en/sochi/*/group/*
Disallow /en/sochi$
Disallow /en/soligorsk$
Disallow /en/sosnovoborsk/*/course/*
Disallow /en/sosnovoborsk/*/group/*
Disallow /en/sosnovoborsk$
Disallow /en/st-julians$
Disallow /en/stary-oskol/*/course/*
Disallow /en/stary-oskol/*/group/*
Disallow /en/stary-oskol$
Disallow /en/stavropol/*/course/*
Disallow /en/stavropol/*/group/*
Disallow /en/stavropol$
Disallow /en/sterlitamak/*/course/*
Disallow /en/sterlitamak/*/group/*
Disallow /en/sterlitamak$
Disallow /en/surgut/*/course/*
Disallow /en/surgut/*/group/*
Disallow /en/surgut$
Disallow /en/svetlogorsk$
Disallow /en/syktyvkar/*/course/*
Disallow /en/syktyvkar/*/group/*
Disallow /en/syktyvkar$
Disallow /en/syzran/*/course/*
Disallow /en/syzran/*/group/*
Disallow /en/syzran$
Disallow /en/taganrog/*/course/*
Disallow /en/taganrog/*/group/*
Disallow /en/taganrog$
Disallow /en/tambov/*/course/*
Disallow /en/tambov/*/group/*
Disallow /en/tambov$
Disallow /en/tolyatti/*/course/*
Disallow /en/tolyatti/*/group/*
Disallow /en/tolyatti$
Disallow /en/tomsk/*/course/*
Disallow /en/tomsk/*/group/*
Disallow /en/tomsk$
Disallow /en/toronto$
Disallow /en/tula/*/course/*
Disallow /en/tula/*/group/*
Disallow /en/tula$
Disallow /en/tver/*/course/*
Disallow /en/tver/*/group/*
Disallow /en/tver$
Disallow /en/tyumen/*/course/*
Disallow /en/tyumen/*/group/*
Disallow /en/ufa/*/course/*
Disallow /en/ufa/*/group/*
Disallow /en/ulan-ude/*/course/*
Disallow /en/ulan-ude/*/group/*
Disallow /en/ulan-ude$
Disallow /en/ulyanovsk/*/course/*
Disallow /en/ulyanovsk/*/group/*
Disallow /en/ulyanovsk$
Disallow /en/uppingham$
Disallow /en/ussuriysk/*/course/*
Disallow /en/ussuriysk/*/group/*
Disallow /en/ussuriysk$
Disallow /en/valencia$
Disallow /en/valletta$
Disallow /en/vancouver$
Disallow /en/verbier$
Disallow /en/vidnoye/*/course/*
Disallow /en/vidnoye/*/group/*
Disallow /en/vidnoye$
Disallow /en/vladikavkaz/*/course/*
Disallow /en/vladikavkaz/*/group/*
Disallow /en/vladikavkaz$
Disallow /en/vladimir/*/course/*
Disallow /en/vladimir/*/group/*
Disallow /en/vladimir$
Disallow /en/vladivostok/*/course/*
Disallow /en/vladivostok/*/group/*
Disallow /en/vladivostok$
Disallow /en/volgodonsk/*/course/*
Disallow /en/volgodonsk/*/group/*
Disallow /en/volgodonsk$
Disallow /en/volgograd/*/course/*
Disallow /en/volgograd/*/group/*
Disallow /en/volgograd$
Disallow /en/vologda/*/course/*
Disallow /en/vologda/*/group/*
Disallow /en/vologda$
Disallow /en/volzhsky/*/course/*
Disallow /en/volzhsky/*/group/*
Disallow /en/volzhsky$
Disallow /en/voronezh/*/course/*
Disallow /en/voronezh/*/group/*
Disallow /en/winchester$
Disallow /en/woldingham$
Disallow /en/yakutsk/*/course/*
Disallow /en/yakutsk/*/group/*
Disallow /en/yakutsk$
Disallow /en/yaroslavl/*/course/*
Disallow /en/yaroslavl/*/group/*
Disallow /en/yekaterinburg/*/course/*
Disallow /en/yekaterinburg/*/group/*
Disallow /en/yelets/*/course/*
Disallow /en/yelets/*/group/*
Disallow /en/yelets$
Disallow /en/yerevan$
Disallow /en/yessentuki/*/course/*
Disallow /en/yessentuki/*/group/*
Disallow /en/yessentuki$
Disallow /en/yevpatoria$
Disallow /en/yoshkar-ola/*/course/*
Disallow /en/yoshkar-ola/*/group/*
Disallow /en/yoshkar-ola$
Disallow /en/yuzhno-sakhalinsk/*/course/*
Disallow /en/yuzhno-sakhalinsk/*/group/*
Disallow /en/yuzhno-sakhalinsk$
Disallow /en/zelenogorsk/*/course/*
Disallow /en/zelenogorsk/*/group/*
Disallow /en/zelenogorsk$
Disallow /en/zelenograd/*/course/*
Disallow /en/zelenograd/*/group/*
Disallow /en/zelenograd$
Disallow /en/zheleznogorsk/*/course/*
Disallow /en/zheleznogorsk/*/group/*
Disallow /en/zheleznogorsk$
Disallow /en/zhukovsky/*/course/*
Disallow /en/zhukovsky/*/group/*
Disallow /en/zhukovsky$
Disallow /en/zlatoust/*/course/*
Disallow /en/zlatoust/*/group/*
Disallow /en/zlatoust$
Disallow /russia/*
Disallow /en/russia/*

*

Rule Path
Disallow /russia/*

megaindex.ru

Rule Path
Disallow /

megaindex.ru

Rule Path
Disallow /

megaindex.ru/2.0

Rule Path
Disallow /

python-requests/2.10.0

Rule Path
Disallow /

python-urllib/2.6

Rule Path
Disallow /

wsdl2objc

Rule Path
Disallow /

dataparksearch/4.54-2016-10-26 (+http://dataparksearch.org/bot)

Rule Path
Disallow /

go-http-client/1.1

Rule Path
Disallow /

riddler (http://riddler.io/about)

Rule Path
Disallow /

bsp spider

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

Warnings

  • 6 invalid lines.
  • `host` is not a known field.