berner-lv.ru
robots.txt

Robots Exclusion Standard data for berner-lv.ru

Resource Scan

Scan Details

Site Domain berner-lv.ru
Base Domain berner-lv.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2025-12-14T20:03:46+00:00
Next Scan 2025-12-28T20:03:46+00:00

Last Successful Scan

Scanned2025-11-05T14:37:55+00:00
URL https://berner-lv.ru/robots.txt
Domain IPs 91.236.116.20
Response IP 91.236.116.20
Found Yes
Hash 0c0f5b0101a5a7a6ac1479d2d800079b587374d1118b7f10b7edbe44911616b9
SimHash 6740dc46e191

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://berner-lv.ru/sitemap.xml

Warnings

  • `host` is not a known field.