bfin.co.kr
robots.txt

Robots Exclusion Standard data for bfin.co.kr

Resource Scan

Scan Details

Site Domain bfin.co.kr
Base Domain bfin.co.kr
Scan Status Ok
Last Scan2025-11-30T00:40:16+00:00
Next Scan 2025-12-07T00:40:16+00:00

Last Scan

Scanned2025-11-30T00:40:16+00:00
URL http://bfin.co.kr/robots.txt
Domain IPs 211.43.220.125
Response IP 211.43.220.125
Found Yes
Hash f33441035be0734b12ced49de17fbb868a1045553def1507f3f46d9a739d2b26
SimHash e096d280c3a7

Groups

applebot

Rule Path
Disallow /RAD/

baiduspider

Rule Path
Disallow /RAD/

bingbot

Rule Path
Disallow /RAD/

discordbot

Rule Path
Disallow /RAD/

facebookexternalhit

Rule Path
Disallow /RAD/

googlebot

Rule Path
Disallow /RAD/

googlebot-image

Rule Path
Disallow /RAD/

ia_archiver

Rule Path
Disallow /RAD/

linkedinbot

Rule Path
Disallow /RAD/

msnbot

Rule Path
Disallow /RAD/

naverbot

Rule Path
Disallow /RAD/

pinterestbot

Rule Path
Disallow /RAD/

seznambot

Rule Path
Disallow /RAD/

slurp

Rule Path
Disallow /RAD/

teoma

Rule Path
Disallow /RAD/

telegrambot

Rule Path
Disallow /RAD/

twitterbot

Rule Path
Disallow /RAD/

yandex

Rule Path
Disallow /RAD/

yeti

Rule Path
Disallow /RAD/

*

Rule Path
Allow /

Other Records

Field Value
crawl-delay 1800