bb-nippon.com
robots.txt

Robots Exclusion Standard data for bb-nippon.com

Resource Scan

Scan Details

Site Domain bb-nippon.com
Base Domain bb-nippon.com
Scan Status Failed
Failure ReasonScan timed out.
Last Scan2024-08-25T08:51:04+00:00
Next Scan 2024-11-23T08:51:04+00:00

Last Successful Scan

Scanned2024-01-29T08:48:31+00:00
URL http://bb-nippon.com/robots.txt
Domain IPs 133.242.50.181
Response IP 133.242.50.181
Found Yes
Hash 67e88399ed6149ae10d37c2d93b23abfb65135e63aa8efec64414e04b26c3e80
SimHash e016d56c02ab

Groups

*

Rule Path
Disallow /administrator/
Disallow /images/
Disallow /templates/
Disallow /beta/
Disallow /newsite/
Disallow /chk/
Disallow /_chk/
Disallow /component/
Disallow /*/comment/add*
Disallow /*/message/add*
Disallow /hb/images/captcha/

baiduspider

No rules defined. All paths allowed.

Other Records

Field Value
crawl-delay 30

yeti

Rule Path
Disallow /

tasapspider

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

nerdbynature.bot

Rule Path
Disallow /