krizovkarsky-slovnik-online.cz
robots.txt
Robots Exclusion Standard data for krizovkarsky-slovnik-online.cz
Resource Scan
Scan Details
| Site Domain | krizovkarsky-slovnik-online.cz |
| Base Domain | krizovkarsky-slovnik-online.cz |
| Scan Status | Ok |
| Last Scan | 2024-09-29T10:36:12+00:00 |
| Next Scan | 2024-10-06T10:36:12+00:00 |
Last Scan
| Scanned | 2024-09-29T10:36:12+00:00 |
| URL | https://krizovkarsky-slovnik-online.cz/robots.txt |
| Domain IPs | 89.221.217.219 |
| Response IP | 89.221.217.219 |
| Found | Yes |
| Hash | cd2c9a4e6a8c0599478371ab9f9467e928305eb5a6d853c9567bc860d0b52609 |
| SimHash | 0a5be4526661 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /oou |
| Disallow | /diskuse |
| Disallow | /cookies |
bingbot
| Rule | Path |
|---|---|
| Disallow | /oou |
| Disallow | /diskuse |
| Disallow | /cookies |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 300 |
grapeshot
| Rule | Path |
|---|---|
| Disallow | /oou |
| Disallow | /diskuse |
| Disallow | /cookies |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 3 |
ahrefsbot
amazonbot
archive.org_bot
baiduspider
barkrowler
bleriot
blexbot
bubing
ccbot
cliqzbot
dataforseobot
dataprovider
desu
deusu
dnyzbot
dotbot
embedly
exabot
genieo
heritrix
ia_archiver
lcc
linguee
linkdexbot
linkpadbot
ltx71
mauibot
megaindex.ru
mj12bot
msnbot
netseer
qwantify
riddler
seekport
semrushbot
semrushbot-sa
seokicks
seokicks-robot
serpstatbot
smtbot
sogou
spbot
spiderling
surdotlybot
turnitinbot
uptimebot
velenpublicwebcrawler
xovibot
yandexbot
| Rule | Path |
|---|---|
| Disallow | / |
Other Records
| Field | Value |
|---|---|
| sitemap | https://krizovkarsky-slovnik-online.cz/sitemap.xml |
Warnings
- 1 invalid line.
- `request-rate` is not a known field.
- `robot-version` is not a known field.