agicap.com
robots.txt

Groups

*

aitcsrobot/1.1
alexibot
aqua_products
arachnophilia
aspider/0.09
asterias
auresys/1.0
b2w/0.1
backdoorbot
backdoorbot/1.0
backrub/.
baiduspider-video
big brother
bizbot003
bizbot04 kirk.overleaf.com
black hole
black.hole
blackwidow
blexbot
blowfish
blowfish/1.0
bookmark search tool
botalot
botrighthere
bspider/1.0 libwww-perl/0.40
builtbottough
bullseye
bullseye/1.0
bunnyslippers
cactvs chemistry spider
ccbot
cegbfeieh
changedetection
chatgpt-user
checkbot/x.xx lwp/5.x
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
chinaclaw
combine/0.0
conceptbot/0.3
copernic
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
custo
cyberpatrol sitecat webbot
cyberspyder/2.1
daumoa
deweb/1.01
disco
disco pump 3.0
disco pump 3.2
discofinder
dittospyder
download demon
download demon/3.2.0.8
download demon/3.5.0.11
dumbot
ecatch
ecatch/3.0
eirgrabber
emailcollector
emailsiphon
emailwolf
enigmabot
erocrawler
explorersearch
express webpictures
express webpictures (www.express-soft.com)
extractorpro
eyenetie
fairad client
felixide/1.0
fido/0.9 harvest/1.4.pl2
fish-search-robot
flaming attackbot
flashget
flashget webwasher 3.2
foobot
freecrawl
frontpage
frontpage [nc,or]
gaisbot
gcreep/1.0
getright
getright/2.11
getright/3.1
getright/3.2
getright/3.3
getright/3.3.3
getright/3.3.4
getright/4.0.0
getright/4.1.0
getright/4.1.1
getright/4.1.2
getright/4.2
getright/4.2b (portuguxeas)
getright/4.2c
getright/4.3
getright/4.5
getright/4.5a
getright/4.5b
getright/4.5b1
getright/4.5b2
getright/4.5b3
getright/4.5b6
getright/4.5b7
getright/4.5c
getright/4.5d
getright/4.5e
getright/5.0beta1
getright/5.0beta2
geturl.rexx v1.05
getweb!
go!zilla
go!zilla (www.gozilla.com)
go!zilla 3.3 (www.gozilla.com)
go!zilla 3.5 (www.gozilla.com)
go-ahead-got-it
golem/1.1
gptbot
grabnet
grafula
gromit/1.0
grub
happyfunbot
harvest
harvest/1.5
hatena antenna
hazel's ferret web hopper
hloader
hmview
httplib
httrack
httrack 3.0
httrack [nc,or]
huaweisymantecspider
humanlinks
image stripper
image sucker
inagist.com url crawler
incywincy/1.0b1
indy library
indy library [nc,or]
infonavirobot
informant
ingrid/0.1
interget
internet ninja
internet ninja 4.0
internet ninja 5.0
internet ninja 6.0
iron33/1.0.2
israelisearch/1.0
iti spider
jennybot
jetcar
joc web spider
jubiirobot
jumpstation
katipo/1.0
kenjin spider
kenjin.spider
keyword density/0.9
keyword.density
kit-fireball/2.0 libwww/5.0a
labelgrab/1.1
leechftp
lexibot
libweb/clshttp
linkextractorpro
linklooker
linkscan/8.1a unix
linkscan/8.1a.unix
linkwalker
lnspiderguy
lwp-trivial
lwp-trivial/1.34
mass downloader
mass downloader/2.2
mata hari
mata.hari
mediafox/x.y
merzscope
metagopher
microsoft url control
microsoft.url
midown tool
miixpc
miixpc/4.2
mister pix
mister pix ii 2.01
mister pix ii 2.02a
mister pix version.dll
mister.pix
moget
moget/2.1
momspider/1.00 libwww-perl/0.40
motor/0.2
msiecrawler
naver
navroad
nearsite
neosciocrawler
net vampire
net vampire/3.0
netants
netcarta cyberpilot pro
netmechanic
netscoop/1.0 libwww/5.0a
netspider
netzip
netzip downloader 1.0 win32(nov 12 1998)
netzip-downloader/1.0.62 (win32; dec 7 1998)
nhsewalker/3.0
nicerspro
nomad-v2.x
npbot
nutch
occam/1.0
octopus
offline explorer
offline navigator
offline.explorer
ogspider
open text site crawler v1.0
openbot
openfind
openfind data gatherer
oracle ultra search
pagegrabber
papa foto
pavuk
pcbrowser
perman
pgp-ka/1.2
propowerbot/2.14
prowebwalker
psbot
python-urllib
queryn metasearch
queryn.metasearch
r6_commentreader
r6_feedfetcher
radiation retriever 1.1
realdownload
reget
repomonkey
repomonkey bait & tackle/v1.01
resume robot
rma
roverbot
safetynet robot 0.1
searchpreview
senrigan/xxxxxx
sitesnagger
slysearch
smartdownload
snooper/b97_01
solbot/1.0 lwp/5.07
sootle
spankbot
spanner
spanner/1.0 (linux 2.0.27 i586)
spyder3.microsys.com
sqworm/2.9.85-beta (beta_release; 20011115-775; i686-pc-linux
superbot
superbot/3.0 (win32)
superbot/3.1 (win32)
superhttp
superhttp/1.0
surfbot
suzuran
szukacz/1.4
takeout
teleport
telesoft
the intraformant
the.intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
true_robot/1.0
turingos
turnitinbot
ucsd-crawler
unisterbot
unwindfetchor/1.0
url control
urlspiderpro
urlck/1.2.3
urly warning
urly.warning
valkyrie/1.0 libwww-perl/0.40
vbseo
vci
vci webviewer vci webviewer win32
voideye
web image collector
web sucker
web.image.collector
webauto
webauto/3.40 (win98; i)
webbandit
webbandit/3.50
webcapture 2.0
webcopier
webcopier v.2.2
webcopier v2.5
webcopier v2.6
webcopier v2.7a
webcopier v2.8
webcopier v3.0
webcopier v3.0.1
webcopier v3.2
webcopier v3.2a
webcopy/
webcrawler/3.0 robot libwww/5.0a
webemailextrac.*
webenhancer
webferret
webfetch
webfetch/2.1.0
webfetcher/0.8,
webgo is
weblayers/0.0
webleacher
weblinker/0.0 libwww-perl/0.1
webmasterworld extractor
webmasterworld extractor
webmasterworldforumbot
webmasterworldforumbot
webmoose/0.0.0000
webreaper
websauger
websauger 1.20b
websauger 1.20j
websauger 1.20k
website extractor
website quester
website quester - www.asona.org
website quester - www.esalesbiz.com/extra/
website.quester
webster pro
webster.pro
webstripper
webvac
webvac/1.0
webwalk
webwalker
webwalker/1.10
webwatch
wget
wget
whowhere robot
widow
wired-digital-newsbot/1.5
www collector
www-collector-e
www.freeloader.com.
wwwoffle
wwwwanderer v3.0
xaldon webspider
xaldon webspider 2.5.b3
xaldon_webspider
xenu's
xenu's link sleuth 1.1c
xget/0.7
yasaklibot
yes
yesupbot
yeti
zeus
zyborg

Other Records

Comments

• Agicap Global robots file DESK / MOB
• https://developers.google.com/search/docs/crawling-indexing/robots/intro
• Contact: Marketing Team Agicap
• FR https://agicap.com/fr/contactez-nous/
• ES https://agicap.com/es/contacto/
• DE https://agicap.com/de/kontakt-aufnehmen/
• EN https://agicap.com/en/contact-us/
• IT https://agicap.com/it/contatto/
• ..::----===--===----::..
• ..:-============: :============-::.
• .:-================: .================-:.
• .-===========-::.. ..::-===========-.
• .-=========-:. .:-=========-.
• :-=======-:. .:-========:
• :=======-: :-=======:
• :=======:. .:=======:
• .-======: Hiring :=======.
• :======: career.agicap.com :======-
• -=====-. .-=====-
• .======: :======.
• .======. .======.
• .======. .======.
• ======. .======
• -=====: .=====-
• .=====- -=====.
• -===== =====-
• .=====- -=====.
• :=====. .=====:
• -===== =====-
• ===:. .:===
• =: ...::::.... ..::---=======----::. :=
• ===:. .==============--:. .:-======---::::::::---=====-:. .:===
• -===== ..::-=====-:. :-====-:. ..:-==== =====-
• :=====. .:-====:. :-===-. ...:::::... .:- .=====:
• .=====- .=========--::. .:-===:.-===:. .:-=================-::. -=====.
• -===== ::....:::--=====-: .:====-. .:====--:.. ..::-====-: =====-
• .=====- .:-====:. -==-. .:===-:. .-==. -=====.
• -=====: ::::::.. .:===-===. .-==-: ..::::::::.. .=====-
• ======. :--=======-:. .===- .-==-. .:-=======--=======-: .======
• .======. ..:-===-. -==: -==-. .-===-:.. .:-===- .======.
• .======. .. .-======. .===: :===-: .:. .======.
• .======: :==--. :===. .===. .-==-. .:::::.. :======.
• -=====-. :-===-. :==: === :==-. :-============: .-=====-
• :======: .-==-:=== -==. :==- -===-.. .:-. :======-
• .-======: .-====: :==: :==- :===: :=======.
• :=======:. :-== === === :==- .:=======:
• :=======-: . ==- :==: === :-=======:
• :-=======-:. .:: :==. :=-: .:-========:
• .-=========-:. .:-=========-.
• .-===========-::.. ..::-===========-.
• .:-================: .================-:.
• ..:-============: :============-:..
• ..::----===--===----::..
• Blocking Spam Bots