Log In Sign Up

ipsi.hoseo.ac.kr
robots.txt

Robots Exclusion Standard data for ipsi.hoseo.ac.kr

Resource Scan

Scan Details

Site Domain ipsi.hoseo.ac.kr
Base Domain hoseo.ac.kr
Scan Status Ok
Last Scan2025-09-01T04:08:36+00:00
Next Scan 2025-10-01T04:08:36+00:00

Last Scan

Scanned2025-09-01T04:08:36+00:00
URL https://ipsi.hoseo.ac.kr/robots.txt
Domain IPs 139.150.231.89
Response IP 139.150.231.89
Found Yes
Hash 218f3534ceb271fd347f2b3f2e8e8260aea16fbc0df6f07a1f6762228477d5dc
SimHash 111c4300fdb0

Groups

*

Rule Path
Disallow /

googlebot

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

yeti

Rule Path
Allow /

bingbot

Rule Path
Allow /

daum

Rule Path
Allow /

daumoa

Rule Path
Allow /

facebot

Rule Path
Allow /

twitterbot

Rule Path
Allow /

telegrambot

Rule Path
Allow /

slackbot

Rule Path
Allow /

discordbot

Rule Path
Allow /

linkedinbot

Rule Path
Allow /

adsbot-google

Rule Path
Allow /

adsbot-google-mobile

Rule Path
Allow /

ahrefsbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

mj12bot

Rule Path
Disallow /

seokicks-robot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

amazonbot

Rule Path
Disallow /

petalbot

Rule Path
Disallow /

wget

Rule Path
Disallow /

curl

Rule Path
Disallow /

python-requests

Rule Path
Disallow /

libwww-perl

Rule Path
Disallow /

httrack

Rule Path
Disallow /

uptimerobot

Rule Path
Disallow /

pingdom

Rule Path
Disallow /
Back to top

Comments

  • 기본: 모든 User-agent 차단
  • 허용: 주요 검색엔진
  • 허용: 소ì
  • 차단: SEO 분석 도구 및 백링크 수집기
  • 차단: AI 학습/스크래퍼 봇
  • 차단: 기타 일반적인 자동화 도구 및 의심 봇
Back to top

Warnings

  • 1 invalid line.
Back to top