czso.cz
robots.txt

Robots Exclusion Standard data for czso.cz

Resource Scan

Scan Details

Site Domain czso.cz
Base Domain czso.cz
Scan Status Ok
Last Scan2024-09-15T03:55:18+00:00
Next Scan 2024-10-15T03:55:18+00:00

Last Scan

Scanned2024-09-15T03:55:18+00:00
URL https://czso.cz/robots.txt
Redirect https://csu.gov.cz/robots.txt
Redirect Domain csu.gov.cz
Redirect Base gov.cz
Domain IPs 194.48.241.132, 2001:67c:16c0:f001::130
Redirect IPs 194.48.241.151, 2001:67c:16c0:f001::151
Response IP 194.48.241.151
Found Yes
Hash c125548a2b97d61a31cf4f60afc3a1943534d5db553e8c811a26a773338e4a3a
SimHash 040c9df46a93

Groups

baiduspider
baiduspider
baiduspider+
baiduspider-video
baiduspider-image

Rule Path
Disallow /

*

Rule Path
Disallow /prave-vydane-rychle-informace
Disallow /just-released-news-releases
Disallow /overeni-tazatele

ahrefsbot

Rule Path
Disallow /prave-vydane-rychle-informace
Disallow /just-released-news-releases
Disallow /overeni-tazatele

Other Records

Field Value
crawl-delay 100

semrushbot
semrushbot-sa

Rule Path
Disallow /prave-vydane-rychle-informace
Disallow /just-released-news-releases
Disallow /overeni-tazatele
Disallow /scitani21/

Other Records

Field Value
crawl-delay 500

Other Records

Field Value
sitemap https://csu.gov.cz/sitemap/statistika/sitemap_index.xml