syleimanov.ru
robots.txt

Groups

addthis.com
addthis.com robot tech.support@clearspring.com
admantx
adsbot-google
adsbot-google-mobile
ahrefsbot
alexibot
applebot
aqua_products
archive.org_bot
asterias
b2w/0.1
backdoorbot/1.0
backlinkcrawler
baiduspider
baiduspider/2.0
baiduspider-image
baiduspider-video
bdbrandprotect
bdcbot
bender
bingbot
bixo
bixocrawler
bixocrawler testcrawler
bixolabs/1.0
bl.uk_lddc_bot
black hole
blackwidow
blexbot
blowfish/1.0
boitho.com-dc
bookmark search tool
botalot
botrighthere
bountiibot
bpimagewalker
bubing
builtbottough
bullseye/1.0
bunnyslippers
businessseek.biz_spider
buzzbot
buzzbot/1.0
camontspider/1.0
catchbot/1.0
catchbot/2.0
catchbot/3.0
catchbot/5.0
cazoodlebot
cegbfeieh
checksem/nutch-1.10
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
chinaclaw
cirrusexplorer/1.1
cispa vulnerability notification
classbot
clickagy intelligence bot v2
converacrawler
copernic
copyrightcheck
cosmos
crawler4j
crawlera/1.10.2
crescent
crescent internet toolpak http ole control v.1.0
crowsnest/0.5
crystalsemanticsbot
cukbot
custo
datagnionbot
dataprovider site explorer
dataprovider/6.101
dataprovider/6.92
dataprovidersiteexplorer
dazoobot/1.0
dblbot/1.0
diffbot
diffbot/0.1
digg deeper/v1
diibot
disco
discobot
discobot/1.0
discobot/1.1
discobot/2.0
discoverybot
discoverybot/2.0
dittospyder
dlvr.it/1.0
domainstatsbot/1.0
dotbot
dotbot/1.1
download ninja
download\ demon
drupact/0.7
dubaiindex
duckduckbot
easouspider
ecatch
ecommercebot
eirgrabber
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
experibot_v1
expertsearchspider
express\ webpictures
extractorpro
eyenetie
ezooms
ezooms/1.0
facebookexternalhit/1.0
facebookexternalhit/1.1
facebookplatform/1.0
facebot/1.0
fairad client
fastbot crawler beta 2.0
fastbot crawler beta 4.0
fasterfox
feedbin
feedly social
feedly/1.0
feedlybot/1.0
feedspot
feedspotbot/1.0
fetch
fetch/2.0a
ffbot/1.0
findlinks
findlinks/1.0
findlinks/1.1.3-beta8
findlinks/1.1.3-beta9
findlinks/1.1.4-beta7
findlinks/1.1.6-beta1
findlinks/1.1.6-beta1 yacy
findlinks/1.1.6-beta2
findlinks/1.1.6-beta3
findlinks/1.1.6-beta4
findlinks/1.1.6-beta5
findlinks/1.1.6-beta6
findlinks/2.0
findlinks/2.0.1
findlinks/2.0.2
findlinks/2.0.4
findlinks/2.0.5
findlinks/2.0.9
findlinks/2.1
findlinks/2.1.3
findlinks/2.1.5
findlinks/2.2
findlinks/2.5
findlinks/2.6
flaming attackbot
flashget
focusbot/1.1
foobot
fyberspider/1.3
g2reader-bot/1.0
gaisbot
garlikcrawler/1.1 (http://garlik.com/, crawler@garlik.com)
genieo
getright
getright/4.2
getweb!
giftghostbot
gigabot
go!zilla
go-ahead-got-it
googlebot
googlebot-image
googlebot-mobile
grabnet
grafula
grapeshotcrawler
grub
grub-client
harvest/1.5
heritrix
hloader
hmview
httplib
httrack
httrack 3.0
huaweisymantecspider
huaweisymantecspider/1.0
humanlinks
ia_archiver
ichiro
image\ stripper
image\ sucker
indy\ library
infonavirobot
integromedb
interget
internet\ ninja
irlbot
iron33/1.0.2
istellabot
jennybot
jetbot
jetcar
jikespider
jobdiggerspider
joc\ web\ spider
jyxobot
kalooga
kenjin spider
keyword density/0.9
larbin
leechftp
lemurwebcrawler
lexibot
lexxebot
lexxebot/1.0
libweb/clshttp
libwww
linguee
linkedinbot/1.0
linkextractorpro
linko
linkscan/8.1a unix
linkwalker
lipperheylinkexplorer
lnspiderguy
lssrocketcrawler/1.0
lwp-trivial
lwp-trivial/1.34
lyt.srv1.5
mail.ru_bot
mass\ downloader
mata hari
mediapartners-google
miadev/0.0.1
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
microsoft.url.control
midown\ tool
miixpc
miixpc/4.2
mister pix
mister\ pix
mlbot
moget
moget/2.1
mozilla/4.0 (compatible; bullseye; windows 95)
mozilla/4.0 (compatible; msie 5.0; windows nt; digext; dts agent
mozilla/5.0 (compatible; spbot/2.0; http://www.seoprofiler.com/bot/ )
mozilla/5.0 (compatible; yandexbot/3.0; +http://yandex.com/bots)
mozilla/5.0 (compatible;picmole/1.0 +http://www.picmole.com)
msiecrawler
msnbot
msnbot-media
najdi.si/3.1
naverbot
navroad
nearsite
nerdbynature.bot
nerdybot
net\ vampire
netants
netestate ne crawler
netmechanic
netseer crawler
netspider
netzip
nextgensearchbot
nicerspro
nutch
obot
ocelli
octopus
offline explorer
offline\ explorer
offline\ navigator
openbot
openfind
openfind data gathere
openfind data gatherer
oracle ultra search
pagegrabber
panscient.com
papa\ foto
paperlibot
pavuk
pcbrowser
penthesilea
perman
phpdig
pinterest/0.1
pinterest/0.2
pixray-seeker
propowerbot/2.14
prowebwalker
proximic
psbot
python-urllib
quepasacreep
queryn metasearch
qwantify
radiation retriever 1.1
realdownload
reget
repomonkey
repomonkey bait & tackle/v1.01
repomonkey bait & tackle/v1.01
rma
rogerbot
roverbot
scoutjet
screaming frog seo spider
searchdaimon.com-dc
searchmetricsbot
searchpreview
semrushbot
semrushbot-sa
seoengbot
seokicks
seokicks-robot
seznam
shopwiki
sistrix
sitebot
sitebot/0.1
sitecheck.internetseer.com
sitesnagger
smartdownload
snapbot
sogou
sogou spider
sogou web spider
sogou web spider/4.0(+http://www.sogou.com/docs/help/webmasters.htm
sogou\ web\ spider
sosospider
sosospider/2.0
sosospider+
sosospider+(+http://help.soso.com/webspider.htm)
spankbot
spanner
spbot
sputnikbot
superbot
superhttp
surfbot
surveybot
suzuran
symfony spider
szukacz/1.4
takeout
teleport
teleport\ pro
teleportpro
telesoft
templeton
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
trovitbot
true_robot
true_robot/1.0
turingos
turnitinbot
turnitinbot/1.5
twengabot
twiceler
twitterbot
unisterbot
updownerbot
url control
url_spider_pro
urly warning
vci
vci webviewer vci webviewer win32
visionutils/0.2
voideye
wbsearchbot
web image collector
web\ image\ collector
web\ sucker
webauto
webbandit
webbandit/3.50
webcapture 2.0
webcopier
webcopier v.2.2
webcopier v3.2a
webenhancer
webfetch
webgo\ is
webleacher
webmasterworldforumbot
webreaper
websauger
website quester
website\ extractor
website\ quester
webster pro
webstripper
webwhacker
webzip
webzip/4.0
webzip/4.21
webzip/5.0
wesee:search
wget
wget/1.5.3
wget/1.6
widow
woozweb-monitoring
woriobot
wotbox
www-collector-e
wwwoffle
xaldon\ webspider
xenu
xenu's
xenu's link sleuth 1.1c
yacybit
yacybot
yandex
yandexbot
yandeximages
yasni
yeti
yodao
yodaobot
youdao
youdaobot
youdaobot/1.0
zealbot
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
zyborg

Warnings

• 4 invalid lines.