bf-os.ru
robots.txt

Robots Exclusion Standard data for bf-os.ru

Resource Scan

Scan Details

Site Domain bf-os.ru
Base Domain bf-os.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't establish SSL connection.
Last Scan2026-01-10T06:50:11+00:00
Next Scan 2026-04-10T06:50:11+00:00

Last Successful Scan

Scanned2025-08-20T19:01:33+00:00
URL https://bf-os.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:1:0:212, 31.31.196.63
Response IP 31.31.196.63
Found Yes
Hash f332410b1ef0df905d91dd301f4b1bde3c5c95061b4944502b8ab830e8f9fa32
SimHash 24188cd45784

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 120 задает таймаут в 120 секунд для всех поисковых роботов