vykladysnu.cz
robots.txt
Robots Exclusion Standard data for vykladysnu.cz
Resource Scan
Scan Details
Site Domain | vykladysnu.cz |
Base Domain | vykladysnu.cz |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a client error. |
Last Scan | 2024-06-25T14:35:50+00:00 |
Next Scan | 2024-07-09T14:35:50+00:00 |
Last Successful Scan
Scanned | 2024-06-10T14:34:58+00:00 |
URL | https://vykladysnu.cz/robots.txt |
Domain IPs | 31.31.79.210 |
Response IP | 31.31.79.210 |
Found | Yes |
Hash | 5d8d476bd1685c125e64d311abf9786aa43cd2d4958f19afb57342ab0bc95a3f |
SimHash | 3adfec52c681 |
Groups
seznambot
sklikbot
bingbot
No rules defined. All paths allowed.
Other Records
Field | Value |
---|---|
crawl-delay | 300 |
ahrefsbot
amazonbot
archive.org_bot
baiduspider
barkrowler
bleriot
blexbot
bubing
ccbot
cliqzbot
dataforseobot
dataprovider
desu
deusu
dnyzbot
dotbot
embedly
exabot
genieo
heritrix
ia_archiver
lcc
linguee
linkdexbot
linkpadbot
ltx71
mauibot
megaindex.ru
mj12bot
msnbot
netseer
riddler
seekport
semrushbot
semrushbot-sa
seokicks
seokicks-robot
serpstatbot
smtbot
sogou
spbot
spiderling
surdotlybot
turnitinbot
uptimebot
velenpublicwebcrawler
xovibot
yandexbot
Rule | Path |
---|---|
Disallow | / |
Other Records
Field | Value |
---|---|
sitemap | https://vykladysnu.cz/sitemap.xml |
Warnings
- 1 invalid line.
- `request-rate` is not a known field.
- `robot-version` is not a known field.