vmeziricsko.cz
robots.txt
Robots Exclusion Standard data for vmeziricsko.cz
Resource Scan
Scan Details
| Site Domain | vmeziricsko.cz |
| Base Domain | vmeziricsko.cz |
| Scan Status | Ok |
| Last Scan | 2024-11-12T07:25:14+00:00 |
| Next Scan | 2024-11-19T07:25:14+00:00 |
Last Scan
| Scanned | 2024-11-12T07:25:14+00:00 |
| URL | https://www.vmeziricsko.cz/robots.txt |
| Domain IPs | 139.59.151.170 |
| Response IP | 139.59.151.170 |
| Found | Yes |
| Hash | 44f415bb6d17be06bc89cc235077fae984b1bc1cbbea48924f99769d96b74903 |
| SimHash | a15dd3536582 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /muj-ucet/ |
| Disallow | /bin/ |
| Disallow | /cache/ |
| Disallow | /library/ |
| Disallow | /tmp/ |
| Disallow | /ajax/ |
| Disallow | /admin/ |
| Disallow | /cron/ |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 10 |
jooblebot
abachobot
aboundexbot
acapbot
acunetix
admantx
adnormcrawler
anarchie
antibot
appie
aspseek
asterias
attach
attribot
autoemailspider
awooo
b2w
backdoorbot
backweb
baiduspider-image
bandit
batchftp
black hole
blackwidow
blowfish
araturka
bot\ mailto
botalot
buddy
buibui-bot
builtbottough
bullseye
bumblebee
bunnyslippers
butterfly
buzzsumo
ccbot
cegbfeieh
checks.panopta.com
cheesebot
cherrypicker
cherrypickerelite
cherrypickerse
chinaclaw
cis455crawler
clariabot
claritybot
claritydailybot
clickagy intelligence bot
clshttp
cms crawler
coast
coldfusion
collector
commoncrawler
commoncrawler node
copier
copyrightcheck
cosmos
crawler4j
crazywebcrawler
crazywebcrawler-spider
crescent
curl
custo
da
dataparksearch
deepcrawl
deusu
dialogsearch
diamond
diffbot
digincore
disco
dittospyder
dj-research
dloader
doc
domain re-animator bot
domainappender
domainmacrocrawler
domainsigmacrawler
dotbot
download
downloader
drip
dts\ agent
easydl
ecatch
eirgrabber
emailcollector
emailsiphon
emailwolf
erocrawler
experibot
express\ webpictures
extractorpro
extreme\ picture\ finder
eyenetie
ezooms robot
fast\ webcrawler
favorg
fetch
fetch\ api\ request
filehound
finbot
findxbot
flashget
flickbot
flipboardproxy
foobot
freefind
friendica
frontpage
generic
getintentcrawler
getproxi
getright
getsmart
getweb!
gigablastopensource
gigabot
gluten free crawler
go-ahead-got-it
go!zilla
gocrawl
gotit
grabber
grabnet
grafula
grapeshot
grapeshotcrawler
grub-client
gsa-crawler
gulliver
guzzlehttp
haosouspider
harvest
hatena star
heretrix
hitboxdoctor
hosttracker/2.0
hosttracker
hloader
hmview
httpapp
httpfetcher
httplib
httpscraper
httptrack
httpviewer
httrack
humanlinks
ia_archiver
image\ stripper
image\ sucker
inagist url resolver
indy\ library
infonavirobot
insitesbot
interget
internet\ ninja
internetseer
iria
irlbot
iskanie
istellabot
jack
james bot
java
jennybot
jersey
jetcar
jobo
joc\ web\ spider
jonzilla
js-kit url resolver
justview
k2spider
kazbtbot
kenjin\ spider
keyword\ density
komodiabot
lachesis
larbin
leechftp
lexibot
lftp
libby_
libweb
libwww-perl
libwwwperl
likse
link
linkdexbot
linkextractorpro
linko
linkpadbot
linkscan
linkwalker
litefinder
livelapbot
lnspiderguy
ls session
lssrocketcrawler
ltx71
lwp-trivial
lwp\ request
madaali
mag-net
magnet
mass\ downloader
mata\ hari
mbot
meanpathbot
megaindex
memo
memorybot
mercator
metacarta
metauri
mewsoft\ search\ engine
mfc_tear_sample
microsoft\ url\ control
microsofturl
midown\ tool
miixpc
mirror
missigua
mister\ pix
moget
msfrontpage
msiecrawler
nationaldirectory\ webspider
nativehost
navroad
nearsite
nerdybot
net\ probe
net\ vampire
netants
netestate ne crawler
netmechanic
netresearchserver
netseer crawler
netshelter contentscan
netspider
netzip
newsme
nexuscache
nicerspro
niki-bot
nikto
ning
ninja
node/simplecrawler
npbot
nutch
obot
octopus
offline explorer
offline\ explorer
offline\ navigator
onestop
openfind
openfind\ data\ gatherer
openhosebot
orangebot
orgprobe
orthogaffe
our\ agent
pad-bot
pagegrabber
panopta
panoptastudybot
panscient
papa\ foto
paperlibot
pavuk
pcbrowser
peerindex
perl
perl lwp
photon
php
php\ version
phpot
ping
pingalink\ monitoring\ services
plukkie
pockey
pompos
postano
privacyawarebot
propowerbot
prowebwalker
proximic
psycheclone
pulsecrawler
pulsepoint xt3 web scraper
pump
python-urllib
python\ urllib
queryn
queryseekerspider
quipu
raven
ravencrawler
rbot
realdownload
reaper
recorded future
recorder
reget
repomonkey
rico
riddler
rma
roboto
robots
robozilla
rogerbot
ruby
rukicrawler
safednsbot
scooter
scoutabout
scrapy
screaming frog seo spider
searchie
semantic-visions
semanticbot
semrushbot-sa
seokicks-robot
seolyticscrawler
showyoubot
simplecrawler
siphon
sistrix crawler
sitecheck
siteluxbot
sitesnagger
slysearch
smartdownload
smeshbot
smtbot
snake
snapbot
snoopy
softlistbot
sogou spider
sogou web spider
sogou web spider/4.0
sogou
spacebison
spankbot
spanner
spiderbot
spider - panopta
spinne
squirrly
sqworm
srmse/nutch
ssearch_bot
stealer
stratagems kumo
stripper
sucker
superbot
superhttp
surdotlybot
surfbot
suzuran
szukacz
takeout
tbot-nutch
telegrambot
teleport
teleportpro
telesoft
the\ intraformant
thenomad
tighttwatbot
titan
tocrawl
true_robot
turingos
turnitinbot
tweetmemebot
twmbot
typhoeus
ubicrawler
umbot-ln
uptimebot
uptimerobot/2.0
uptimerobot
urldispatcher
urly\ warning
vacuum
vagabondo
vayala
vci
vebot
vericitecrawler
vintage
voideye
voltron
wbsearchbot
web\ downloader
web\ image\ collector
web\ sucker
webauto
webbandit
webcopier
webdownloader
webenhancer
webfetch
webgo
webhook
webindex
webleacher
webmasterworldforumbot
webminer
webmirror
webmole
webreaper
websauger
website
website\ extractor
website\ quester
websites
webster
webster\ pro
webstripper
websucker
webviewer
webvulncrawl
webvulnscan
webwhacker
webzip
wells
wesee_bot
wget
whacker
widow
wildsoft
winhttp
winhttprequest
wiseguys robot
woobot
woriobot
wotbox
www-collector-e
wwwoffle
x-cad-se
xaldon
xara
xenu
xovibot
y!tunnelpro
yacybot
yioopbot
zade
zao
zbot
zealbot
zeus
zumbot
zyborg
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.vmeziricsko.cz/sitemap/ |
Warnings
- 3 invalid lines.
Comments