hkbf.org
robots.txt

Robots Exclusion Standard data for hkbf.org

Resource Scan

Scan Details

Site Domain hkbf.org
Base Domain hkbf.org
Scan Status Ok
Last Scan2025-10-18T18:11:39+00:00
Next Scan 2025-10-25T18:11:39+00:00

Last Scan

Scanned2025-10-18T18:11:39+00:00
URL https://hkbf.org/robots.txt
Domain IPs 104.21.88.246, 172.67.154.128, 2606:4700:3030::6815:58f6, 2606:4700:3036::ac43:9a80
Response IP 172.67.154.128
Found Yes
Hash 8a027875aaca02d8f80c243da82ee5fe8106091d76c8dbfd28bf6b3959aed1cb
SimHash 801e102b68b2

Groups

baiduspider

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

yodaobot

Rule Path
Disallow /

sosospider+

Rule Path
Disallow /

easouspider

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

criteobot/0.1

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

*

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 3600