houjin.info
robots.txt

Robots Exclusion Standard data for houjin.info

Resource Scan

Scan Details

Site Domain houjin.info
Base Domain houjin.info
Scan Status Ok
Last Scan2025-11-04T14:07:55+00:00
Next Scan 2025-11-11T14:07:55+00:00

Last Scan

Scanned2025-11-04T14:07:55+00:00
URL https://houjin.info/robots.txt
Redirect https://www.houjin.info/robots.txt
Redirect Domain www.houjin.info
Redirect Base houjin.info
Domain IPs 103.141.96.2
Redirect IPs 103.141.96.2
Response IP 103.141.96.2
Found Yes
Hash 3cef05e9885941c549d48e25cb2965d16b90535029a21bf265960e03d621a565
SimHash 425ec0e2c119

Groups

bingbot

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

mj12bot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

yandex

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

*

Rule Path
Disallow /common/
Disallow /commons/