Log In Sign Up

boardlife.co.kr
robots.txt

Robots Exclusion Standard data for boardlife.co.kr

Resource Scan

Scan Details

Site Domain boardlife.co.kr
Base Domain boardlife.co.kr
Scan Status Ok
Last Scan2025-10-29T05:38:30+00:00
Next Scan 2025-11-05T05:38:30+00:00

Last Scan

Scanned2025-10-29T05:38:30+00:00
URL https://boardlife.co.kr/robots.txt
Domain IPs 211.233.62.67
Response IP 211.233.62.67
Found Yes
Hash 1606b01fbefe9f64a85559c7eecefc441f45aae4abb770a57c52b64a618fd435
SimHash 01150c50f581

Groups

googlebot

Rule Path
Disallow

bingbot

Rule Path
Disallow

yeti

Rule Path
Disallow

duckduckbot

Rule Path
Disallow

applebot

Rule Path
Disallow

gptbot

Rule Path
Disallow

chatgpt-user

Rule Path
Disallow

ccbot

Rule Path
Disallow

perplexitybot

Rule Path
Disallow

anthropic-bot

Rule Path
Disallow

google-extended

Rule Path
Disallow

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

baiduspider

Rule Path
Disallow /

sogou

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

yandexbot

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

curl

Rule Path
Disallow /

wget

Rule Path
Disallow /

archive.org_bot

Rule Path
Disallow /

ia_archiver

Rule Path
Disallow /

*

Rule Path
Disallow /admin/
Disallow /login/
Disallow /logout/
Disallow /write/
Disallow /AD/
Allow /
Back to top

Other Records

Field Value
sitemap https://boardlife.co.kr/sitemap.xml
sitemap https://boardlife.co.kr/sitemap_4424061_images.xml
sitemap https://boardlife.co.kr/sitemap_4424061_images1.xml
sitemap https://boardlife.co.kr/sitemap_4424061_images2.xml
sitemap https://boardlife.co.kr/sitemap_4424061_video.xml
Back to top

Comments

  • ✅ 정상 검색 엔진 허용
  • ✅ AI 크롤러 허용
  • 🛑 무거운 SEO / 백링크 크롤러 차단
  • 🛑 중국, 러시아 봇 및 기타 과도한 트래픽 유발 크롤러 차단
  • 🛑 커맨드라인 봇 차단 (스크래퍼, 공격봇 의심)
  • ✅ 기본 경로 설정 (기타 봇)
  • ✅ 사이트맵
Back to top