hoiku-lib.com
robots.txt

Robots Exclusion Standard data for hoiku-lib.com

Resource Scan

Scan Details

Site Domain hoiku-lib.com
Base Domain hoiku-lib.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-08-25T16:15:06+00:00
Next Scan 2024-11-23T16:15:06+00:00

Last Successful Scan

Scanned2024-01-29T16:13:14+00:00
URL https://hoiku-lib.com/robots.txt
Domain IPs 54.192.18.105, 54.192.18.123, 54.192.18.34, 54.192.18.86
Response IP 18.155.129.44
Found Yes
Hash 829c8ef6023e00de1b1acad8070c193c8d75ad169be4e2c3ad6c0eed1dfc1cb2
SimHash 58094012cfb2

Groups

mj12bot

Rule Path
Disallow /

ahrefs

Rule Path
Disallow /

webmeup

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baidu

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

twitterbot

Rule Path
Disallow

*

Rule Path
Allow /
Disallow /api/

Other Records

Field Value
sitemap https://hoiku-lib.com/sitemap.xml