Log In Sign Up

cbdb.cz
robots.txt

Robots Exclusion Standard data for cbdb.cz

Resource Scan

Scan Details

Site Domain cbdb.cz
Base Domain cbdb.cz
Scan Status Ok
Last Scan2024-06-15T16:59:34+00:00
Next Scan 2024-06-22T16:59:34+00:00

Last Scan

Scanned2024-06-15T16:59:34+00:00
URL https://cbdb.cz/robots.txt
Redirect https://www.cbdb.cz/robots.txt
Redirect Domain www.cbdb.cz
Redirect Base cbdb.cz
Domain IPs 185.183.8.127, 2a00:1ed0:1:1800:7:3d:7400:1
Redirect IPs 185.183.8.127, 2a00:1ed0:1:1800:7:3d:7400:1
Response IP 185.183.8.127
Found Yes
Hash dd8df3c4cd15f22bd89edaafc004f24954459db5c963d44a219e1270fea8996f
SimHash 5a07d9758205

Groups

baiduspider

Rule Path
Disallow /

yandex

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

rogerbot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

mail.ru

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

exabot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

screaming frog seo spider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

sentibot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

slurp

Rule Path
Disallow /

grapeshot

Rule Path
Disallow /

seekportbot

Rule Path
Disallow /

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 5

seznambot

Rule Path
Allow /
Back to top

Other Records

Field Value
sitemap https://www.cbdb.cz/sitemap.xml
sitemap https://www.cbdb.cz/sitemap1.xml
sitemap https://www.cbdb.cz/sitemap2.xml
sitemap https://www.cbdb.cz/sitemap3.xml
sitemap https://www.cbdb.cz/sitemap4.xml
sitemap https://www.cbdb.cz/sitemap5.xml
sitemap https://www.cbdb.cz/sitemap6.xml
sitemap https://www.cbdb.cz/sitemap7.xml
sitemap https://www.cbdb.cz/sitemap10.xml
sitemap https://www.cbdb.cz/sitemap/a/0.xml
sitemap https://www.cbdb.cz/sitemap/a/1.xml
sitemap https://www.cbdb.cz/sitemap/a/2.xml
sitemap https://www.cbdb.cz/sitemap/a/3.xml
sitemap https://www.cbdb.cz/sitemap/a/4.xml
sitemap https://www.cbdb.cz/sitemap/a/5.xml
sitemap https://www.cbdb.cz/sitemap/u/0.xml
sitemap https://www.cbdb.cz/sitemap/u/1.xml
sitemap https://www.cbdb.cz/sitemap/u/2.xml
sitemap https://www.cbdb.cz/sitemap/u/3.xml
sitemap https://www.cbdb.cz/sitemap/u/4.xml
sitemap https://www.cbdb.cz/sitemap/u/5.xml
sitemap https://www.cbdb.cz/sitemap/u/6.xml
sitemap https://www.cbdb.cz/sitemap/u/7.xml
sitemap https://www.cbdb.cz/sitemap/u/8.xml
sitemap https://www.cbdb.cz/sitemap/u/9.xml
sitemap https://www.cbdb.cz/sitemap/u/10.xml
sitemap https://www.cbdb.cz/sitemap/u/11.xml
sitemap https://www.cbdb.cz/sitemap/u/12.xml
sitemap https://www.cbdb.cz/sitemap/u/13.xml
sitemap https://www.cbdb.cz/sitemap/u/14.xml
sitemap https://www.cbdb.cz/sitemap/u/15.xml
sitemap https://www.cbdb.cz/sitemap/t/0.xml
sitemap https://www.cbdb.cz/sitemap/t/1.xml
sitemap https://www.cbdb.cz/sitemap/bm/0.xml
sitemap https://www.cbdb.cz/sitemap/bm/1.xml
sitemap https://www.cbdb.cz/sitemap/bm/2.xml
sitemap https://www.cbdb.cz/sitemap/bm/3.xml
sitemap https://www.cbdb.cz/sitemap/bm/4.xml
sitemap https://www.cbdb.cz/sitemap/bm/5.xml
sitemap https://www.cbdb.cz/sitemap/bm/6.xml
sitemap https://www.cbdb.cz/sitemap/bm/7.xml
Back to top

Warnings

  • `request-rate` is not a known field.
Back to top