vse-otkritky.ru
robots.txt

Robots Exclusion Standard data for vse-otkritky.ru

Resource Scan

Scan Details

Site Domain vse-otkritky.ru
Base Domain vse-otkritky.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-13T01:29:26+00:00
Next Scan 2025-02-11T01:29:26+00:00

Last Successful Scan

Scanned2023-12-27T01:14:21+00:00
URL http://vse-otkritky.ru/robots.txt
Domain IPs 31.31.196.26
Response IP 31.31.196.26
Found Yes
Hash 17464e7262222155c3b0f4e6e1cdd34b8e03fce8d5f295f142be97449c6b29a4
SimHash 6418ccd3c7b5

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 40 задает таймаут в 40 секунд для всеÑ

Warnings

  • 2 invalid lines.