light-probeg.ru
robots.txt

Robots Exclusion Standard data for light-probeg.ru

Resource Scan

Scan Details

Site Domain light-probeg.ru
Base Domain light-probeg.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2025-12-22T21:16:44+00:00
Next Scan 2026-03-22T21:16:44+00:00

Last Successful Scan

Scanned2025-08-02T16:09:27+00:00
URL https://light-probeg.ru/robots.txt
Domain IPs 2a00:15f8:a000:5:1:11:8:7ab, 2a00:15f8:a000:5:1:12:8:7ab, 2a00:15f8:a000:5:1:13:8:7ab, 2a00:15f8:a000:5:1:14:8:7ab, 90.156.201.29, 90.156.201.45, 90.156.201.83, 90.156.201.86
Response IP 90.156.201.83
Found Yes
Hash 5a1ae37786689d9e7ee0e04b45d78166b4a51adce518d7f575381559db2eaaac
SimHash 6510c0d54733

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 3

Other Records

Field Value
sitemap https://light-probeg.ru/sitemap.xml