crtv.cz
robots.txt

Robots Exclusion Standard data for crtv.cz

Resource Scan

Scan Details

Site Domain crtv.cz
Base Domain crtv.cz
Scan Status Ok
Last Scan2024-09-28T16:30:44+00:00
Next Scan 2024-10-05T16:30:44+00:00

Last Scan

Scanned2024-09-28T16:30:44+00:00
URL https://crtv.cz/robots.txt
Redirect http://www.crtv.cz/robots.txt
Redirect Domain www.crtv.cz
Redirect Base crtv.cz
Domain IPs 83.167.244.201
Redirect IPs 83.167.244.201
Response IP 83.167.244.201
Found Yes
Hash adbe8cb9bea2ed57886146194e458baeb40cc59a120be4211ffbe1188de0b717
SimHash e458dd46c477

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 2

Comments

  • See http://www.robotstxt.org/orig.html for documentation