czechfreepress.cz
robots.txt

Robots Exclusion Standard data for czechfreepress.cz

Resource Scan

Scan Details

Site Domain czechfreepress.cz
Base Domain czechfreepress.cz
Scan Status Ok
Last Scan2024-11-14T14:27:15+00:00
Next Scan 2024-11-21T14:27:15+00:00

Last Scan

Scanned2024-11-14T14:27:15+00:00
URL https://czechfreepress.cz/robots.txt
Redirect https://www.czechfreepress.cz/robots.txt
Redirect Domain www.czechfreepress.cz
Redirect Base czechfreepress.cz
Domain IPs 185.129.138.202
Redirect IPs 185.129.138.202
Response IP 185.129.138.202
Found Yes
Hash a48ecd94bed0babc58e994388d1d64c2ef9835b2a937cb970272b50820bd0c28
SimHash 61015c64c333

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

Warnings

  • `request-rate` is not a known field.