ci-unix.ru
robots.txt

Robots Exclusion Standard data for ci-unix.ru

Resource Scan

Scan Details

Site Domain ci-unix.ru
Base Domain ci-unix.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2025-05-13T08:49:49+00:00
Next Scan 2025-06-12T08:49:49+00:00

Last Successful Scan

Scanned2025-04-14T08:48:38+00:00
URL https://ci-unix.ru/robots.txt
Domain IPs 37.230.118.213
Response IP 37.230.118.213
Found Yes
Hash 7657e031e0f1a82f95546a5d320f67e2218f8621ff92c4ad06c7b2b67adc459f
SimHash 61589c46cc91

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 9

Other Records

Field Value
sitemap http://www.ci-unix.ru/sitemap.xml