tandempubblicita.it
robots.txt

Groups

acoon
admantx platform semantic analyzer
ahrefsbot
aihitbot
alexibot
asterias
backdoorbot/1.0
backlinkcrawler
baiduspider
baiduspider/2.0
bingbot/2.0
binlar_2.6.3
black hole
blowfish/1.0
botalot
builtbottough
bullseye
bullseye/1.0
bunnyslippers
ccbot
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
cms crawler
mozilla/4.0 (cms crawler: http://www.cmscrawler.com)
compspybot
compspybot/1.0
content crawler spider
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
dataprovider site explorer
dcpbot/1.2
discobot
disco pump 3.1
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
extractorpro
ezooms
facebookexternalhit/1.1
facebookplatform/1.0
grapeshotcrawler/2.0
hailoo news crawler
harvest/1.5
hloader
httplib
humanlinks
ia_archiver
infonavirobot
istellabot
istellabot/1.01.18
istellabot/1.01.18 +http://www.tiscali.it/
mozilla/5.0 (compatible; istellabot/1.01.18 +http://www.tiscali.it/)
mozilla/5.0 (compatible; istellabot/1.10.2 +http://www.tiscali.it/)
jikespider
jennybot
kenjin spider
lexibot
libweb/clshttp
linguee
linguee bot
linkextractorpro
linkscan/8.1a unix
linkwalker
lssrocketcrawler/1.0 lightspeedsystems
ltbot
lwp-trivial
lwp-trivial/1.34
macinroy privacy auditors
mail.ru
mata hari
meanpathbot/1.0
microsoft data access internet publishing provider protocol discovery
microsoft url
microsoft-webdav-miniredir/5.1.2600
miixpc
mister pix
miixpc/4.2
mj12bot
mj12bot/v1.4.3
mlbot
moget
moget/2.1
ncbot
nerdbynature.bot
netants
netattache
netmechanic
netseer
netseer crawler/2.0
mozilla/5.0 (compatible; netseer crawler/2.0; +http://www.netseer.com/crawler.html; crawler@netseer.com)
nicerspro
obot
obot/2.3.1
offline explorer
openfind
openfind data gathere
openindexdeepspider
openindexdeepspider/nutch-1.5-dev
openindexshallowspider
openindexshallowspider/nutch-1.5-dev
openindexspider
openindexspider/nutch-1.5-dev
ows v0.1.4
pagesinventory
plukkie
plukkie/1.5
propowerbot/2.14
prowebwalker
proximic
queryn metasearch
quickobot/quickobot-1
repomonkey
rexyobot
rma
searchmetricsbot
seexie.com_bot
semrushbot
semrushbot/0.96.2
seokicks-robot
seznambot
sistrix
sistrix crawler
mozilla/5.0 (compatible; sistrix crawler; http://crawler.sistrix.net/)
siteexplorer/1.0b
sitesnagger
socialbm_bot
socialbm_bot/1.0
solomonobot/1.04
solomonobot/1.05
sosospider/2.0
spankbot
spanner
spbot
spbot/3.0
speedy spider
spider
superbot
surveybot
suzuran
swebot
szukacz/1.4
tbot
tbot/1.0
mozilla/5.0 (compatible; tbot/1.0;)
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
toscrawler/nutch-1.6
true_robot
turingos
turnitinbot
tweetmemebot
tweetmemebot/2.11
unisterbot
mozilla/5.0 (compatible; unisterbot; crawler@unister.de)
urly warning
vci
vci webviewer vci webviewer win32
voluniabot
wbsearchbot
wbsearchbot/1.1
webauto
webbandit
webbandit/3.50
webcopier
webcopy
web image collector
webenhancer
webmasterworldforumbot
webmirror
webnl
webreaper
website extractor
website quester
websauger
webster pro
webstripper
webstripper/2.02
webzip
webzip/4.0
wget
wget/1.5.3
wget/1.6
winhttrack
wotbox/2.0
wotbox/2.0
wotbox/2.01
www-collector-e
www.integromedb.org/crawler
xenu's
yandexbot
zeus
zeus 32297 webster pro v2.9 win32

Warnings

• 2 invalid lines.