kyoto.hb-nippon.com
robots.txt

Robots Exclusion Standard data for kyoto.hb-nippon.com

Resource Scan

Scan Details

Site Domain kyoto.hb-nippon.com
Base Domain hb-nippon.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonCouldn't connect to server.
Last Scan2024-04-12T07:17:46+00:00
Next Scan 2024-07-11T07:17:46+00:00

Last Successful Scan

Scanned2023-05-26T05:49:51+00:00
URL http://kyoto.hb-nippon.com/robots.txt
Domain IPs 133.242.50.181
Response IP 133.242.50.181
Found Yes
Hash 67e88399ed6149ae10d37c2d93b23abfb65135e63aa8efec64414e04b26c3e80
SimHash e016d56c02ab

Groups

*

Rule Path
Disallow /administrator/
Disallow /images/
Disallow /templates/
Disallow /beta/
Disallow /newsite/
Disallow /chk/
Disallow /_chk/
Disallow /component/
Disallow /*/comment/add*
Disallow /*/message/add*
Disallow /hb/images/captcha/

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yeti

Rule Path
Disallow /

tasapspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /