mnemodno.ru
robots.txt

Robots Exclusion Standard data for mnemodno.ru

Resource Scan

Scan Details

Site Domain mnemodno.ru
Base Domain mnemodno.ru
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-09-13T20:17:50+00:00
Next Scan 2024-12-12T20:17:50+00:00

Last Successful Scan

Scanned2024-02-17T20:00:54+00:00
URL https://mnemodno.ru/robots.txt
Domain IPs 2a00:f940:2:2:1:1:0:166, 31.31.196.204
Response IP 31.31.196.204
Found Yes
Hash 17464e7262222155c3b0f4e6e1cdd34b8e03fce8d5f295f142be97449c6b29a4
SimHash 6418ccd3c7b5

Groups

*

No rules defined. All paths allowed.

Other Records

Field Value Comment
crawl-delay 40 задает таймаут в 40 секунд для всеÑ

Warnings

  • 2 invalid lines.