simplypermits.com
robots.txt

Groups

*

mediapartners-google
googlebot
googlebot-image
bingbot

rogerbot
mj12bot
dotbot
ahrefsbot
semrushbot
semrushbot
abonti
ahrefsbot
bdcbot
blexbot
builtbottough
bullseye
bunnyslippers
ccbot
cegbfeieh
cheesebot
cherrypicker
copyrightcheck
crescent
doc
dittospyder
dotbot
download ninja
easouspider
emailcollector
emailsiphon
emailwolf
erocrawler
exabot
extractorpro
fasterfox
feedbooster
foobot
genieo
httrack
harvest
incutio
infonavirobot
istellabot
java/1.
jennybot
kenjin spider
keyword density/0.9
lnspiderguy
lexibot
linkscan/8.1a unix
linkwalker
linkextractorpro
miixpc
mj12bot
msiecrawler
mata hari
maxpointcrawler
megaindex
microsoft url control
mippin
missigua locator
mister pix
nicerspro
npbot
netants
niki-bot
nutch
offline explorer
openfind
php/5.{
propowerbot/2.14
prowebwalker
python-urllib
queryn metasearch
rma
repomonkey
sistrix
seznambot
sitesnagger
snappreviewbot
sogou
spankbot
spinn3r
szukacz/1.4
teleport
telesoft
the intraformant
thenomad
tighttwatbot
titan
true_robot
turnitinbot
urly warning
ubicrawler
unisterbot
unknown
vci
wbsearchbot
www-collector-e
web downloader/6.9
web image collector
webauto
webbandit
webcopier
webenhancer
webreaper
websauger
webstripper
webzip
webmasterworldforumbot
website quester
webster pro
wotbox
xenu
zao
zeus
zyborg
aggregator
asterias
ca-crawler
coccoc
cosmos
discobot
grub-client
hloader
httplib
humanlinks
ieautodiscovery
k2spider
larbin
libweb
libwww
linko
lmspider
lwp-trivial
magpie
memorybot
moget
panscient.com
serf
sitecheck.internetseer.com
spanner
spbot
suzuran
tocrawl/urldispatcher
turingos
uptime files
wsr-agent
yandex
asterias
backdoorbot/1.0
black hole
blowfish/1.0
botalot
builtbottough
bullseye/1.0
bunnyslippers
cegbfeieh
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
dittospyder
emailcollector
emailsiphon
emailwolf
erocrawler
extractorpro
foobot
harvest/1.5
hloader
httplib
humanlinks
ia_archiver
infonavirobot
jennybot
kenjin spider
keyword density/0.9
lexibot
libweb/clshttp
linkextractorpro
linkscan/8.1a unix
linkwalker
lnspiderguy
lwp-trivial
lwp-trivial/1.34
mata hari
microsoft url control - 5.01.4511
microsoft url control - 6.00.8169
miixpc
miixpc/4.2
mister pix
moget
moget/2.1
mozilla/4
mozilla/4.0 (compatible; bullseye; windows 95)
mozilla/4.0 (compatible; msie 4.0; windows 95)
mozilla/4.0 (compatible; msie 4.0; windows 98)
mozilla/4.0 (compatible; msie 4.0; windows nt)
mozilla/4.0 (compatible; msie 4.0; windows xp)
mozilla/4.0 (compatible; msie 4.0; windows 2000)
mozilla/4.0 (compatible; msie 4.0; windows me)
mozilla/5
netants
nicerspro
offline explorer
openfind
openfind data gathere
propowerbot/2.14
prowebwalker
queryn metasearch
repomonkey
repomonkey bait & tackle/v1.01
rma
sitesnagger
spankbot
spanner
suzuran
szukacz/1.4
teleport
teleportpro
telesoft
the intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
true_robot/1.0
turingos
urly warning
vci
vci webviewer vci webviewer win32
web image collector
webauto
webbandit
webbandit/3.50
webcopier
webenhancer
webmasterworldforumbot
websauger
website quester
webster pro
webstripper
webzip
webzip/4.0
wget
wget/1.5.3
wget/1.6
www-collector-e
xenu's
xenu's link sleuth 1.1c
zeus
zeus 32297 webster pro v2.9 win32

No rules defined. All paths allowed.

Other Records

Comments

• Negative Robots Blocking