Log In Sign Up

csu.gov.cz
robots.txt

Robots Exclusion Standard data for csu.gov.cz

Resource Scan

Scan Details

Site Domain csu.gov.cz
Base Domain gov.cz
Scan Status Ok
Last Scan2025-03-03T11:36:38+00:00
Next Scan 2025-04-02T11:36:38+00:00

Last Scan

Scanned2025-03-03T11:36:38+00:00
URL https://csu.gov.cz/robots.txt
Domain IPs 194.48.241.151, 2001:67c:16c0:f001::151
Response IP 194.48.241.151
Found Yes
Hash c125548a2b97d61a31cf4f60afc3a1943534d5db553e8c811a26a773338e4a3a
SimHash 040c9df46a93

Groups

baiduspider
baiduspider
baiduspider+
baiduspider-video
baiduspider-image

Rule Path
Disallow /

*

Rule Path
Disallow /prave-vydane-rychle-informace
Disallow /just-released-news-releases
Disallow /overeni-tazatele

ahrefsbot

Rule Path
Disallow /prave-vydane-rychle-informace
Disallow /just-released-news-releases
Disallow /overeni-tazatele

Other Records

Field Value
crawl-delay 100

semrushbot
semrushbot-sa

Rule Path
Disallow /prave-vydane-rychle-informace
Disallow /just-released-news-releases
Disallow /overeni-tazatele
Disallow /scitani21/

Other Records

Field Value
crawl-delay 500
Back to top

Other Records

Field Value
sitemap https://csu.gov.cz/sitemap/statistika/sitemap_index.xml
Back to top