devian.cz
robots.txt

Robots Exclusion Standard data for devian.cz

Resource Scan

Scan Details

Site Domain devian.cz
Base Domain devian.cz
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-08-10T10:16:10+00:00
Next Scan 2025-11-08T10:16:10+00:00

Last Successful Scan

Scanned2024-07-17T10:13:59+00:00
URL http://devian.cz/robots.txt
Domain IPs 81.2.195.32
Response IP 81.2.195.32
Found Yes
Hash a48ecd94bed0babc58e994388d1d64c2ef9835b2a937cb970272b50820bd0c28
SimHash 61015c64c333

Groups

*

Rule Path
Disallow

Other Records

Field Value
crawl-delay 5

Warnings

  • `request-rate` is not a known field.