isvouga.pt
robots.txt
Robots Exclusion Standard data for isvouga.pt
Resource Scan
Scan Details
Site Domain | isvouga.pt |
Base Domain | isvouga.pt |
Scan Status | Ok |
Last Scan | 2024-10-21T22:49:41+00:00 |
Next Scan | 2024-11-20T22:49:41+00:00 |
Last Scan
Scanned | 2024-10-21T22:49:41+00:00 |
URL | https://isvouga.pt/robots.txt |
Domain IPs | 162.159.136.54 |
Response IP | 162.159.136.54 |
Found | Yes |
Hash | c2f1d46e8f6fc1c0072987da3ebf02a9b08d80f68442c69895f615d71a9618fd |
SimHash | 57f5d2a3e937 |
Groups
*
Rule | Path |
---|---|
Disallow | /android/FYa/ |
Disallow | /awd/545843.php |
Disallow | /soft/0500122/ |
Disallow | /soft/8JLfY.shtml |
Disallow | /bak/q0xYG/ |
Disallow | /soft/0500122/ |
Disallow | /soft/8JLfY.shtml |
Disallow | /thnews/Av/ |
Disallow | /ani/WT/ |
Disallow | /games/* |
Disallow | /android/* |
Disallow | /ios/* |
Disallow | /soft/0l7/ |
Disallow | /xiazai/Cve1K/ |
Disallow | /*.aspx |
Disallow | /*.asp |
Disallow | /*.html |
Disallow | /*.xls |
Disallow | /*.csv |
Disallow | /*.doc |
Disallow | /*.shtml |
Disallow | /*.ppt |
*
Rule | Path |
---|---|
Disallow | /wp-login.php |
Disallow | /wp-admin |
Disallow | /wp-includes |
Disallow | /wp-content |
Allow | /wp-content/uploads/ |
*
Rule | Path |
---|---|
Disallow | /*feed/ |
Disallow | /*?s= |
Disallow | *thankyou* |
Disallow | *bu%3D* |
Disallow | *limitstart%3D* |
aitcsrobot/1.1
alexibot
aqua_products
arachnophilia
aspider/0.09
asterias
auresys/1.0
b2w/0.1
backdoorbot
backdoorbot/1.0
backrub/.
baiduspider-video
big brother
bizbot003
bizbot04 kirk.overleaf.com
black hole
black.hole
blackwidow
blexbot
blowfish
blowfish/1.0
bookmark search tool
botalot
botrighthere
bspider/1.0 libwww-perl/0.40
builtbottough
bullseye
bullseye/1.0
bunnyslippers
cactvs chemistry spider
cegbfeieh
changedetection
checkbot/x.xx lwp/5.x
cheesebot
cherrypicker
cherrypickerelite/1.0
cherrypickerse/1.0
chinaclaw
combine/0.0
conceptbot/0.3
copernic
copyrightcheck
cosmos
crescent
crescent internet toolpak http ole control v.1.0
custo
cyberpatrol sitecat webbot
cyberspyder/2.1
daumoa
deweb/1.01
disco
disco pump 3.0
disco pump 3.2
discofinder
dittospyder
download demon
download demon/3.2.0.8
download demon/3.5.0.11
dumbot
ecatch
ecatch/3.0
eirgrabber
emailcollector
emailsiphon
emailwolf
enigmabot
erocrawler
explorersearch
express webpictures
express webpictures (www.express-soft.com)
extractorpro
eyenetie
fairad client
felixide/1.0
fido/0.9 harvest/1.4.pl2
fish-search-robot
flaming attackbot
flashget
flashget webwasher 3.2
foobot
freecrawl
frontpage
frontpage [nc,or]
gaisbot
gcreep/1.0
getright
getright/2.11
getright/3.1
getright/3.2
getright/3.3
getright/3.3.3
getright/3.3.4
getright/4.0.0
getright/4.1.0
getright/4.1.1
getright/4.1.2
getright/4.2
getright/4.2b (portuguxeas)
getright/4.2c
getright/4.3
getright/4.5
getright/4.5a
getright/4.5b
getright/4.5b1
getright/4.5b2
getright/4.5b3
getright/4.5b6
getright/4.5b7
getright/4.5c
getright/4.5d
getright/4.5e
getright/5.0beta1
getright/5.0beta2
geturl.rexx v1.05
getweb!
go!zilla
go!zilla (www.gozilla.com)
go!zilla 3.3 (www.gozilla.com)
go!zilla 3.5 (www.gozilla.com)
go-ahead-got-it
golem/1.1
google-extended
gptbot
grabnet
grafula
gromit/1.0
grub
happyfunbot
harvest
harvest/1.5
hatena antenna
hazel's ferret web hopper
hloader
hmview
httplib
httrack
httrack 3.0
httrack [nc,or]
huaweisymantecspider
humanlinks
image stripper
image sucker
inagist.com url crawler
incywincy/1.0b1
indy library
indy library [nc,or]
infonavirobot
informant
ingrid/0.1
interget
internet ninja
internet ninja 4.0
internet ninja 5.0
internet ninja 6.0
iron33/1.0.2
israelisearch/1.0
iti spider
jennybot
jetcar
joc web spider
jubiirobot
jumpstation
katipo/1.0
kenjin spider
kenjin.spider
keyword density/0.9
keyword.density
kit-fireball/2.0 libwww/5.0a
labelgrab/1.1
leechftp
lexibot
libweb/clshttp
linkextractorpro
linklooker
linkscan/8.1a unix
linkscan/8.1a.unix
linkwalker
lnspiderguy
lwp-trivial
lwp-trivial/1.34
mass downloader
mass downloader/2.2
mata hari
mata.hari
mediafox/x.y
merzscope
metagopher
microsoft url control
microsoft.url
midown tool
miixpc
miixpc/4.2
mister pix
mister pix ii 2.01
mister pix ii 2.02a
mister pix version.dll
mister.pix
moget
moget/2.1
momspider/1.00 libwww-perl/0.40
motor/0.2
msiecrawler
naver
navroad
nearsite
neosciocrawler
net vampire
net vampire/3.0
netants
netcarta cyberpilot pro
netmechanic
netscoop/1.0 libwww/5.0a
netspider
netzip
netzip downloader 1.0 win32(nov 12 1998)
netzip-downloader/1.0.62 (win32; dec 7 1998)
nhsewalker/3.0
nicerspro
nomad-v2.x
npbot
nutch
occam/1.0
octopus
offline explorer
offline navigator
offline.explorer
ogspider
open text site crawler v1.0
openbot
openfind
openfind data gatherer
oracle ultra search
pagegrabber
papa foto
pavuk
pcbrowser
perman
pgp-ka/1.2
propowerbot/2.14
prowebwalker
psbot
python-urllib
queryn metasearch
queryn.metasearch
r6_commentreader
r6_feedfetcher
radiation retriever 1.1
realdownload
reget
repomonkey
repomonkey bait & tackle/v1.01
resume robot
rma
roverbot
safetynet robot 0.1
searchpreview
senrigan/xxxxxx
sitesnagger
slysearch
smartdownload
snooper/b97_01
solbot/1.0 lwp/5.07
sootle
spankbot
spanner
spanner/1.0 (linux 2.0.27 i586)
spyder3.microsys.com
sqworm/2.9.85-beta (beta_release; 20011115-775; i686-pc-linux
superbot
superbot/3.0 (win32)
superbot/3.1 (win32)
superhttp
superhttp/1.0
surfbot
suzuran
szukacz/1.4
takeout
teleport
telesoft
the intraformant
the.intraformant
thenomad
tighttwatbot
titan
tocrawl/urldispatcher
true_robot
true_robot/1.0
turingos
turnitinbot
ucsd-crawler
unisterbot
unwindfetchor/1.0
url control
urlspiderpro
urlck/1.2.3
urly warning
urly.warning
valkyrie/1.0 libwww-perl/0.40
vbseo
vci
vci webviewer vci webviewer win32
voideye
web image collector
web sucker
web.image.collector
webauto
webauto/3.40 (win98; i)
webbandit
webbandit/3.50
webcapture 2.0
webcopier
webcopier v.2.2
webcopier v2.5
webcopier v2.6
webcopier v2.7a
webcopier v2.8
webcopier v3.0
webcopier v3.0.1
webcopier v3.2
webcopier v3.2a
webcopy/
webcrawler/3.0 robot libwww/5.0a
webemailextrac.*
webenhancer
webferret
webfetch
webfetch/2.1.0
webfetcher/0.8,
webgo is
weblayers/0.0
webleacher
weblinker/0.0 libwww-perl/0.1
webmasterworld extractor
webmasterworld extractor
webmasterworldforumbot
webmasterworldforumbot
webmoose/0.0.0000
webreaper
websauger
websauger 1.20b
websauger 1.20j
websauger 1.20k
website extractor
website quester
website quester - www.asona.org
website quester - www.esalesbiz.com/extra/
website.quester
webster pro
webster.pro
webstripper
webvac
webvac/1.0
webwalk
webwalker
webwalker/1.10
webwatch
wget
wget
whowhere robot
widow
wired-digital-newsbot/1.5
www collector
www-collector-e
www.freeloader.com.
wwwoffle
wwwwanderer v3.0
xaldon webspider
xaldon webspider 2.5.b3
xaldon_webspider
xenu's
xenu's link sleuth 1.1c
xget/0.7
yasaklibot
yes
yesupbot
yeti
zeus
zyborg
Rule | Path |
---|---|
Disallow | / |
Comments