bitbus.co.kr
robots.txt

Robots Exclusion Standard data for bitbus.co.kr

Resource Scan

Scan Details

Site Domain bitbus.co.kr
Base Domain bitbus.co.kr
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a client error.
Last Scan2024-05-02T19:29:55+00:00
Next Scan 2024-07-31T19:29:55+00:00

Last Successful Scan

Scanned2023-12-12T10:22:17+00:00
URL https://bitbus.co.kr/robots.txt
Domain IPs 52.84.251.110, 52.84.251.38, 52.84.251.80, 52.84.251.98
Response IP 52.84.174.30
Found Yes
Hash 49bf6d714c2142a3b1e55061697aec274741d2bcc499a80db2435be9211e80da
SimHash 6819795025d0

Groups

*

Rule Path
Allow /
Disallow /site_join
Disallow /site_join_agree
Disallow /login
Disallow /logout.cm
Disallow /shop_cart
Disallow /?mode*

*

Rule Path
Disallow /

googlebot
cowbot
naverbot
yeti
daumoa

Rule Path
Disallow /admin/
Disallow /config/
Disallow /data/
Disallow /module/
Disallow /tmp/

Other Records

Field Value
sitemap https://bitbus.co.kr/sitemap.xml