hokej.cz
robots.txt

Robots Exclusion Standard data for hokej.cz

Resource Scan

Scan Details

Site Domain hokej.cz
Base Domain hokej.cz
Scan Status Ok
Last Scan2024-06-24T19:23:42+00:00
Next Scan 2024-07-01T19:23:42+00:00

Last Scan

Scanned2024-06-24T19:23:42+00:00
URL https://hokej.cz/robots.txt
Redirect https://www.hokej.cz/robots.txt
Redirect Domain www.hokej.cz
Redirect Base hokej.cz
Domain IPs 46.234.119.228
Redirect IPs 46.234.119.228
Response IP 46.234.119.228
Found Yes
Hash d1b4f1ec91eade649a4fa7d7f56079a730e354abba2ad0d8b39da021980e6c31
SimHash 6b1c9092e61b

Groups

*

Rule Path
Allow /

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 5

claudebot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 10

semrushbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

ahrefsbot

No rules defined. All paths allowed.

Warnings

  • `​crawl-delay` is not a known field.