Log In Sign Up

shostka.net
robots.txt

Robots Exclusion Standard data for shostka.net

Resource Scan

Scan Details

Site Domain shostka.net
Base Domain shostka.net
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2026-02-08T21:32:33+00:00
Next Scan 2026-05-09T21:32:33+00:00

Last Successful Scan

Scanned2023-07-01T18:20:30+00:00
URL http://shostka.net/robots.txt
Domain IPs 185.104.45.49, 2a06:6440:0:2d31::1
Response IP 185.104.45.49
Found Yes
Hash 8a234a4a25c11e256ddd60c82f6f79ae00bad312e219c7f5ebafd2ad63a13e1f
SimHash fd816e62c335

Groups

yandex

Rule Path
Disallow /admin/

Other Records

Field Value
crawl-delay 5
Back to top

Warnings

  • `host` is not a known field.
  • `request-rate` is not a known field.
Back to top