familytree.ru
robots.txt

Robots Exclusion Standard data for familytree.ru

Resource Scan

Scan Details

Site Domain familytree.ru
Base Domain familytree.ru
Scan Status Ok
Last Scan2024-11-09T20:09:52+00:00
Next Scan 2024-11-16T20:09:52+00:00

Last Scan

Scanned2024-11-09T20:09:52+00:00
URL https://familytree.ru/robots.txt
Domain IPs 81.177.141.30
Response IP 81.177.141.30
Found Yes
Hash 3d94cf0df0af8b369cb1cd0fb675b0bde37e9a91ec7c2523887344ccca20b1cc
SimHash 4158cc73c731

Groups

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 60

Warnings

  • `host` is not a known field.