krizovky-slovnik.cz
robots.txt

Robots Exclusion Standard data for krizovky-slovnik.cz

Resource Scan

Scan Details

Site Domain krizovky-slovnik.cz
Base Domain krizovky-slovnik.cz
Scan Status Ok
Last Scan2024-09-24T09:52:52+00:00
Next Scan 2024-10-01T09:52:52+00:00

Last Scan

Scanned2024-09-24T09:52:52+00:00
URL https://krizovky-slovnik.cz/robots.txt
Domain IPs 89.221.217.219
Response IP 89.221.217.219
Found Yes
Hash dc50108f0d585b4d275ed6a1e8efc25279b857e1e3302a9df0cbb96514c43076
SimHash 2a5ae45286b0

Groups

*

Rule Path
Disallow /oou
Disallow /cookies

bingbot

Rule Path
Disallow /oou
Disallow /cookies

Other Records

Field Value
crawl-delay 30

ahrefsbot
amazonbot
archive.org_bot
baiduspider
barkrowler
bleriot
blexbot
bubing
ccbot
cliqzbot
dataforseobot
dataprovider
desu
deusu
dnyzbot
dotbot
embedly
exabot
genieo
heritrix
ia_archiver
lcc
linguee
linkdexbot
linkpadbot
ltx71
mauibot
megaindex.ru
mj12bot
msnbot
netseer
qwantify
riddler
seekport
semrushbot
semrushbot-sa
seokicks
seokicks-robot
serpstatbot
smtbot
sogou
spbot
spiderling
surdotlybot
turnitinbot
uptimebot
velenpublicwebcrawler
xovibot
yandexbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://krizovky-slovnik.cz/sitemap.xml

Warnings

  • 1 invalid line.