lettrepratique.fr
robots.txt

Groups

aqua_products
ahrefsbot/4.0
ahrefsbot/3.1
ahrefsbot/3.0
ahrefsbot/2.0
ahrefsbot/1.0
ahrefsbot
asterias
b2w/0.1
baiduspider
baidu
baiduspider-video
baiduspider-image
biggerbetter
black hole
blowfish/1.0
bookmark search tool
botalot
builtbottough
bullseye/1.0
bunnyslippers
ccbot
cegbfeieh
cheesebot
cherrypicker
cherrypicker /1.0
cherrypickerelite/1.0
cherrypickerse/1.0
contextad bot
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
dittospyder
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
extractorpro
fairad client
flaming attackbot
foobot
gaisbot
getright/4.2
grapeshot
grapeshotcrawler
grub
grub-client
harvest/1.5
hloader
httplib
humanlinks
ia_archiver
ia_archiver/1.6
infonavirobot
iron33/1.0.2
jennybot
kenjin spider
keyword density/0.9
larbin
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lnspiderguy
lwp-trivial
lwp-trivial/1.34
mata hari
microsoft url control
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
moget
moget/2.1
mozilla/4
mozilla/4.0 (compatible; bullseye; windows 95)
mozilla/4.0 (compatible; msie 4.0; windows 2000)
mozilla/4.0 (compatible; msie 4.0; windows 95)
mozilla/4.0 (compatible; msie 4.0; windows 98)
mozilla/4.0 (compatible; msie 4.0; windows me)
mozilla/4.0 (compatible; msie 4.0; windows nt)
mozilla/4.0 (compatible; msie 4.0; windows xp)
mozilla/5
msiecrawler
netants
netmechanic
nicerspro
offline explorer
openbot
openfind
openfind data gathere
oracle ultra search
perman
propowerbot/2.14
proximic
prowebwalker
psbot
python-urllib
queryn metasearch
radiation retriever 1.1
repomonkey
repomonkey bait & tackle/v1.01
rma
searchpreview
sitesnagger
spankbot
spanner
spider
suzuran
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
true_robot/1.0
turingos
turnitinbot
url control
url_spider_pro
urly warning
vci
vci webviewer vci webviewer win32
voilabot
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webenhancer
webmasterworldforumbot
websauger
website quester
webster pro
webstripper
webzip
webzip/4.0
wget
wget/1.5.3
wget/1.6
www-collector-e
wasalive
xenu's
xenu's link sleuth 1.1c
yacybot
zeus
zeus 32297 webster pro v2.9 win32
zeus link scout
yandexbot

googlebot

ahrefsbot

w3c-checklink

w3c_validator

w3c_css_validator

yandex

baiduspider

archive.org_bot

ia_archiver

faviconizer

ahrefsbot

a6-indexer/1.0

butterfly

exabot

grapeshot

mail.ru

nutch

pingdom

proximic

python

searchmetricsbot

seznambot

sogou web spider

sogou spider

sogou

youdaobot

sosospider

spbot

wget

yie8

mj12bot

turnitinbot

blexbot

hivabot

nerdybot

updown_tester

androiddownloadmanager

voltron

xenu's link sleuth 1.1c

semrushbot

semrushbot-sa

obot

riddler

mail.ru_bot

mail.ru

Comments

• 135 robots to keep away - Yellowpipe.com

Warnings

• 2 invalid lines.