essens-spb.ru
robots.txt

Robots Exclusion Standard data for essens-spb.ru

Resource Scan

Scan Details

Site Domain essens-spb.ru
Base Domain essens-spb.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2026-01-26T15:56:48+00:00
Next Scan 2026-02-02T15:56:48+00:00

Last Successful Scan

Scanned2025-12-26T15:45:18+00:00
URL https://essens-spb.ru/robots.txt
Domain IPs 186.2.175.37
Response IP 186.2.175.37
Found Yes
Hash 1c2ac7e5324635d857fe903879a2072a8df8d6d1c0c0cf226a96b4e6a6b9fdcd
SimHash 6718dcc3e4b1

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 4.5

Other Records

Field Value
sitemap https://essens-spb.ru/sitemap.xml

Warnings

  • `host` is not a known field.