bemil.chosun.com
robots.txt

Robots Exclusion Standard data for bemil.chosun.com

Resource Scan

Scan Details

Site Domain bemil.chosun.com
Base Domain chosun.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-11-09T16:41:03+00:00
Next Scan 2025-01-08T16:41:03+00:00

Last Successful Scan

Scanned2024-08-19T16:38:49+00:00
URL https://bemil.chosun.com/robots.txt
Domain IPs 3.36.0.242, 43.202.169.137
Response IP 43.202.169.137
Found Yes
Hash c620f6160a822a47d4db894158b8e9f2c37d5cee5abf61fee44d3794236ff31e
SimHash 48109b421362

Groups

googlebot

Rule Path
Allow /
Disallow /bbsM*
Disallow /inc*

chatgpt-user

Rule Path
Disallow /

*

Rule Path
Allow /
Disallow /bbsM*
Disallow /inc*