brodart.ca
robots.txt

Groups

gptbot
chatgpt-user
perplexitybot
amazonbot
claudebot
omgilibot
facebookbot
applebot
anthropic-ai
bytespider
claude-web
diffbot
imagesiftbot
omgilibot
omgili
youbot

aitcsrobot/1.1
aspider/0.09
auresys/1.0
alexibot
aqua_products
arachnophilia
blexbot
bspider/1.0libwww-perl/0.40
backdoorbot
backdoorbot/1.0
backrub/.
baiduspider-video
bigbrother
bizbot04kirk.overleaf.com
bizbot003
black.hole
blackhole
blackwidow
blowfish
blowfish/1.0
bookmarksearchtool
botalot
botrighthere
botmailto:craftbot@yahoo.com
builtbottough
bullseye
bullseye/1.0
bunnyslippers
cactvschemistryspider
cegbfeieh
changedetection
checkbot/x.xxlwp/5.x
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
chinaclaw
copernic
copyrightcheck
crescent
crescentinternettoolpakhttpolecontrolv.1.0
custo
cyberpatrolsitecatwebbot
cyberspyder/2.1
disco
discofinder
discopump3.0
discopump3.2
daumoa
deweb/1.01
dittospyder
downloaddemon
downloaddemon/3.2.0.8
downloaddemon/3.5.0.11
eirgrabber
emailcollector
emailsiphon
emailwolf
enigmabot
erocrawler
expresswebpictures
expresswebpictures(www.express-soft.com)
extractorpro
eyenetie
fairadclient
felixide/1.0
fish-search-robot
flamingattackbot
flashget
flashgetwebwasher3.2
foobot
freecrawl
frontpage
frontpage[ncor]
gaisbot
getright
getright/2.11
getright/3.1
getright/3.2
getright/3.3
getright/3.3.3
getright/3.3.4
getright/4.0.0
getright/4.1.0
getright/4.1.1
getright/4.1.2
getright/4.2
getright/4.2b(portuguxeas)
getright/4.2c
getright/4.3
getright/4.5
getright/4.5a
getright/4.5b
getright/4.5b1
getright/4.5b2
getright/4.5b3
getright/4.5b6
getright/4.5b7
getright/4.5c
getright/4.5d
getright/4.5e
getright/5.0beta1
getright/5.0beta2
geturl.rexxv1.05
getweb!
go!zilla
go!zilla(www.gozilla.com)
go!zilla3.3(www.gozilla.com)
go!zilla3.5(www.gozilla.com)
go-ahead-got-it
golem/1.1
grabnet
grafula
gromit/1.0
hmview
httrack
httrack3.0
httrack[ncor]
happyfunbot
harvest
harvest/1.5
hatenaantenna
huaweisymantecspider
h‰m‰h‰kki/0.2
ingrid/0.1
itispider
imagestripper
imagesucker
incywincy/1.0b1
indylibrary
indylibrary[ncor]
infonavirobot
informant
interget
internetninja
internetninja4.0
internetninja5.0
internetninja6.0
iron33/1.0.2
israelisearch/1.0
jocwebspider
jennybot
jetcar
jubiirobot
kit-fireball/2.0libwww/5.0a
katipo/1.0
kenjin.spider
kenjinspider
keyword.density
keyworddensity/0.9
lnspiderguy
labelgrab/1.1
leechftp
lexibot
linkscan/8.1a.unix
linkscan/8.1aunix
linkwalker
linkextractorpro
metagopher
midowntool
miixpc
miixpc/4.2
momspider/1.00libwww-perl/0.40
msiecrawler
massdownloader
massdownloader/2.2
mata.hari
matahari
mediafox/x.y
merzscope
microsoft.url
microsofturlcontrol
microsofturlcontrol-5.01.4511
microsofturlcontrol-6.00.8169
mister.pix
misterpix
misterpixversion.dll
misterpixii2.01
misterpixii2.02a
motor/0.2
nhsewalker/3.0
nicerspro
npbot
navroad
nearsite
neosciocrawler
netants
netants/1.10
netants/1.23
netants/1.24
netants/1.25
netcartacyberpilotpro
netmechanic
netscoop/1.0libwww/5.0a
netspider
netvampire
netvampire/3.0
netzip
netzip-downloader/1.0.62(win32;dec71998)
netzipdownloader1.0win32(nov121998)
netzippy+(http://www.innerprise.net/usp-spider.asp)
nomad-v2.x
nutch
ogspider
occam/1.0
octopus
offline.explorer
offlineexplorer
offlineexplorer/1.2
offlineexplorer/1.4
offlineexplorer/1.6
offlineexplorer/1.7
offlineexplorer/1.9
offlineexplorer/2.0
offlineexplorer/2.1
offlineexplorer/2.3
offlineexplorer/2.4
offlineexplorer/2.5
offlinenavigator
opentextsitecrawlerv1.0
openbot
openfind
openfinddatagatherer
oracleultrasearch
pgp-ka/1.2
pagegrabber
papafoto
perman
propowerbot/2.14
prowebwalker
python-urllib
queryn.metasearch
querynmetasearch
r6_commentreader
r6_feedfetcher
rma
radiationretriever1.1
reget
realdownload
realdownload/4.0.0.40
realdownload/4.0.0.41
realdownload/4.0.0.42
repomonkey
repomonkeybait&tackle/v1.01
resumerobot
roverbot
safetynetrobot0.1
semrushbot
senrigan/xxxxxx
sitesnagger
slysearch
smartdownload
smartdownload/1.2.76(win32;apr11999)
smartdownload/1.2.77(win32;aug171999)
smartdownload/1.2.77(win32;feb12000)
smartdownload/1.2.77(win32;jun192001)
snooper/b97_01
solbot/1.0lwp/5.07
spankbot
spanner/1.0(linux2.0.27i586)
sqworm/2.9.85-beta(beta_release;20011115-775;i686-pc-linux
superbot
superbot/3.0(win32)
superbot/3.1(win32)
superhttp
superhttp/1.0
surfbot
szukacz/1.4
teleport
teleportpro
teleportpro/1.29
teleportpro/1.29.1590
teleportpro/1.29.1634
teleportpro/1.29.1718
teleportpro/1.29.1820
teleportpro/1.29.1847
telesoft
the.intraformant
theintraformant
thenomad
tighttwatbot
titan
true_robot
true_robot/1.0
turnitinbot
ucsd-crawler
urlcontrol
urlspiderpro
urly.warning
urlywarning
unisterbot
unwindfetchor/1.0
vci
vciwebviewervciwebviewerwin32
valkyrie/1.0libwww-perl/0.40
voideye
www-collector-e
wwwcollector
wwwoffle
wwwwandererv3.0
web.image.collector
webauto
webauto/3.40(win98;i)
webbandit
webbandit/3.50
webcapture2.0
webcopier
webcopierv.2.2
webcopierv2.5
webcopierv2.6
webcopierv2.7a
webcopierv2.8
webcopierv3.0
webcopierv3.0.1
webcopierv3.2
webcopierv3.2a
webcopy/
webcrawler/3.0robotlibwww/5.0a
webemailextrac.*
webenhancer
webferret
webfetch
webfetcher/0.8
webgois
webimagecollector
webleacher
weblinker/0.0libwww-perl/0.1
webmoose/0.0.0000
webreaper
webreaper[info@webreaper.net]
webreaper[webreaper@otway.com]
webreaperv9.1-www.otway.com/webreaper
webreaperv9.7-www.webreaper.net
webreaperv9.8-www.webreaper.net
webreapervwebreaperv7.3-wwwotway.com/webreaper
websauger
websauger1.20b
websauger1.20j
websauger1.20k
webstripper
webstripper/2.03
webstripper/2.10
webstripper/2.12
webstripper/2.13
webstripper/2.15
webstripper/2.16
webstripper/2.19
websucker
webvac
webwalker
webwalker/1.10
webwatch
webwhacker
webzip
webzip/2.75(http://www.spidersoft.com)
webzip/3.65(http://www.spidersoft.com)
webzip/3.80(http://www.spidersoft.com)
webzip/4.0(http://www.spidersoft.com)
webzip/4.1(http://www.spidersoft.com)
webzip/4.21
webzip/4.21(http://www.spidersoft.com)
webzip/5.0
webzip/5.0(http://www.spidersoft.com)
webzip/5.0pr1(http://www.spidersoft.com)
webzip/4.0
webmasterworldextractor
webmasterworldforumbot
website.quester
websitequester
websitequester-www.asona.org
websitequester-www.esalesbiz.com/extra/
websiteextractor
webster.pro
websterpro
wget
wget/1.4.0
wget/1.5.2
wget/1.5.3
wget/1.6
wget/1.7
wget/1.8
wget/1.8.1
wget/1.8.1+cvs
wget/1.8.2
wget/1.9-beta
whowhererobot
widow
xget/0.7
xaldonwebspider
xaldonwebspider2.5.b3
xaldon_webspider
yasaklibot
yesupbot
yeti
zeus
zeus11389websterprov2.9win32
zeus11652websterprov2.9win32
zeus18018websterprov2.9win32
zeus26378websterprov2.9win32
zeus30747websterprov2.9win32
zeus32297websterprov2.9win32
zeus39206websterprov2.9win32
zeus41641websterprov2.9win32
zeus44238websterprov2.9win32
zeus51070websterprov2.9win32
zeus51674websterprov2.9win32
zeus51837websterprov2.9win32
zeus63567websterprov2.9win32
zeus6694websterprov2.9win32
zeus82016websterprov2.9win32
zeus82900websterprov2.9win32
zeus84842websterprov2.9win32
zeus90872websterprov2.9win32
zeus94934websterprov2.9win32
zeus95245websterprov2.9win32
zeus95351websterprov2.9win32
zeus97371websterprov2.9win32
zeuslinkscout
zyborg
adidxbot
asterias
b2w/0.1
baiduspider
baiduspider-image
baiduspider-mobile
baiduspider-news
baiduspider-video
combine/0.0
conceptbot/0.3
cosmos
dumbot
ecatch
ecatch/3.0
es
explorersearch
fido/0.9harvest/1.4.pl2
gcreep/1.0
grub
hloader
httplib
humanlinks
inagist.comurlcrawler
jumpstation
larbin
larbin(samualt9@bigfoot.com)
larbin_2.6.2(kabura@sushi.com)
larbin_2.6.2(larbin2.6.2@unspecified.mail)
larbin_2.6.2(listonatccdotgatechdotedu)
larbin_2.6.2(vitalbox1@hotmail.com)
larbin_2.6.2kabura@sushi.com
larbin_2.6.2larbin2.6.2@unspecified.mail
larbin_2.6.2larbin@correa.org
larbin_2.6.2listonatccdotgatechdotedu
larbin_2.6.2vitalbox1@hotmail.com
larbinsamualt9@bigfoot.com
libweb/clshttp
linklooker
lwp-trivial
lwp-trivial/1.34
moget
moget/2.1
msnbot
msnbot-media
naver
pavuk
pcbrowser
psbot
searchpreview
slurp
sootle
spanner
spyder3.microsys.com
suzuran
takeout
tocrawl/urldispatcher
turingos
urlck/1.2.3
vbseo
webfetch/2.1.0
weblayers/0.0
webs@recruit.co.jp
webvac/1.0
webwalk
wget
wired-digital-newsbot/1.5
www.freeloader.com.
yandex
yandexbot
yes
petalbot
bytedance
bytespider

*

No rules defined. All paths allowed.

Other Records

*

Comments

• Block AI Bots:
• Block Most Bots: