logrog.co.kr
robots.txt

Robots Exclusion Standard data for logrog.co.kr

Resource Scan

Scan Details

Site Domain logrog.co.kr
Base Domain logrog.co.kr
Scan Status Ok
Last Scan2025-12-12T20:13:42+00:00
Next Scan 2026-01-11T20:13:42+00:00

Last Scan

Scanned2025-12-12T20:13:42+00:00
URL https://logrog.co.kr/robots.txt
Domain IPs 133.186.155.169
Response IP 133.186.155.169
Found Yes
Hash 8667f1146c39586a756a4eb19f902e4efe97d1bbbde7aebd6107224eff930490
SimHash 48541c024782

Groups

*

Rule Path
Disallow

googlebot

Rule Path
Disallow /admin/
Disallow /config/
Disallow /module/
Disallow /tmp/
Disallow /board/
Disallow /service/

naverbot

Rule Path
Disallow /admin/
Disallow /config/
Disallow /module/
Disallow /tmp/
Disallow /board/
Disallow /service/

yeti

Rule Path
Allow /

daumoa

Rule Path
Disallow /admin/
Disallow /config/
Disallow /module/
Disallow /tmp/
Disallow /board/
Disallow /service/

mj12bot
semrushbot
claudebot
gptbot
dotbot
screaming frog seo spider
heritrix
bingbot
owasp
geofeed
dirbuster-1.0-rc1
pfinapp
droid build

Rule Path
Disallow /

Other Records

Field Value
crawl-delay 10

Comments

  • 특수 봇/스팸성 봇 차단
  • 크롤링 속도 제한 (선택사항)