calculators.pl
robots.txt

Groups

shopwiki
omniexplorer_bot
freefind
becomebot
nutch
jetbot
askjeeves
teoma
jeeves
webvac
stanford
scooter
naver
dumbot
hatena antenna
grub-client
grub
looksmart
webzip
larbin
b2w/0.1
copernic
psbot
python-urllib
netmechanic
url_spider_pro
cherrypicker
emailcollector
emailsiphon
webbandit
emailwolf
extractorpro
copyrightcheck
crescent
sitesnagger
prowebwalker
cheesebot
lnspiderguy
alexibot
stanford comp sci
miixpc
telesoft
website quester
moget/2.1
webzip/4.0
webstripper
websauger
webcopier
netants
mister pix
webauto
thenomad
www-collector-e
rma
libweb/clshttp
asterias
httplib
turingos
spanner
infonavirobot
harvest/1.5
bullseye/1.0
crescent internet toolpak http ole control v.1.0
cherrypickerse/1.0
cherrypickerelite/1.0
webbandit/3.50
nicerspro
microsoft url control - 5.01.4511
dittospyder
foobot
webmasterworldforumbot
spankbot
botalot
lwp-trivial/1.34
lwp-trivial
http://www.webmasterworld.com bot
bunnyslippers
microsoft url control - 6.00.8169
urly warning
wget/1.6
wget/1.5.3
wget
linkwalker
cosmos
moget
hloader
humanlinks
linkextractorpro
offline explorer
mata hari
lexibot
web image collector
the intraformant
true_robot/1.0
true_robot
blowfish/1.0
http://www.searchengineworld.com bot
jennybot
miixpc/4.2
builtbottough
propowerbot/2.14
backdoorbot/1.0
tocrawl/urldispatcher
webenhancer
suzuran
vci webviewer vci webviewer win32
vci
szukacz/1.4
queryn metasearch
openfind data gathere
openfind
xenu's link sleuth 1.1c
xenu's
zeus
repomonkey bait & tackle/v1.01
repomonkey
microsoft url control
openbot
url control
zeus link scout
zeus 32297 webster pro v2.9 win32
webster pro
erocrawler
linkscan/8.1a unix
keyword density/0.9
kenjin spider
iron33/1.0.2
bookmark search tool
fairad client
gaisbot
aqua_products
radiation retriever 1.1
webmasterworld extractor
flaming attackbot
oracle ultra search
msiecrawler
perman
searchpreview
sootle
es
enterprise_search/1.0
enterprise_search
scoutjet
zumbot
zmeu
zend_http_client
youdaobot
yodaobot
yisouspider
yamanalab-robot
xpymep\.exe
www\.integromedb\.org
wotbot
websitetheweb\.com
webindetail\.com
webcapture
wbsearchbot
visaduhoc\.info
turnitinbot
the\ incutio\ xml-rpc\ php\ library
surveybot
speedy
sosospider
solomonobot
sogou
socialsearcher
snoopy
sitebot
sistrix
seoengworldbot
semrushbot
searchmetrics
screenerbot
rojerbot
riddler
queryseekerspider
purebot
proximic
procogseobot
peoplepal
pagesinventory
openwebindex
ocelli
nextgensearchbot
netseer
netestate\ ne\ crawler
netcraftsurveyagent
ncbot
msie\ or\ firefox\ mutant
magpie\-crawler
ltbot
lipperhey
linkdex\.com
lindex\.com
libwww-perl
jikespider
jakarta\ commons-httpclient
ip\-web\-crawler\.com
indy\ library
gigabot
ftrf\:\ friendly
ezooms
ezinearticleslinkscanner
exabot
easouspider
dow\ jones\ searchbot
dotnetdotcom
dotbot
discoverybot
dinoping
dataprovider\.com
curious
compspybot
comodo-certificates-spider
comodo
clipish
charlotte
catchbot
butterfly
brandwatch.net
baiduspider
backlinkcrawler
awcheckbot
aihitbot
ahrefsbot
add\ catalog
accelobot
aboundex
pear
nutch
lynx
java
ia_archiver
http_request2
http_request
domaincrawler
curl
seo-crawling
blexbot
mj12bot
crawler
domaincrawler
spbot
scrapy
seokicks-robot
cliqzbot
linkdexbot
ucrawler
jetbot/1.0
ia_archiver
ia_archiver/1.6
teleport
teleportpro
mozilla/4.0 (compatible; bullseye; windows 95)
szukacz/1.4
openfind
getright/4.2
sentibot

*

Warnings

• 4 invalid lines.