yna.co.kr
robots.txt

Robots Exclusion Standard data for yna.co.kr

Resource Scan

Scan Details

Site Domain yna.co.kr
Base Domain yna.co.kr
Scan Status Ok
Last Scan2024-11-09T14:36:22+00:00
Next Scan 2024-11-16T14:36:22+00:00

Last Scan

Scanned2024-11-09T14:36:22+00:00
URL https://yna.co.kr/robots.txt
Redirect https://www.yna.co.kr/robots.txt
Redirect Domain www.yna.co.kr
Redirect Base yna.co.kr
Domain IPs 211.33.130.21
Redirect IPs 211.33.130.21
Response IP 211.33.130.21
Found Yes
Hash 1ce964e11d26153376bfeff68e8b8d23650a7bc576fea7e1ebfe531e374a0786
SimHash cb0dfe03a4a1

Groups

*

Rule Path
Allow /
Disallow /*?*cp=
Disallow /view/AEN*
Disallow /view/ACK*
Disallow /view/AJP*
Disallow /view/AAR*
Disallow /view/ASP*
Disallow /view/AFR*
Disallow /hc.html
Disallow /search/
Disallow /search/*?*query=
Disallow /did/
Disallow /program/
Disallow /web/
Disallow /irclub/
Disallow /changwon/
Disallow /gangwon-do/
Disallow /view/AKR20150422172700003
Disallow /view/AKR20140829043800065
Disallow /view/AKR20140829043851065
Disallow /view/AKR20170628100600004
Disallow /view/AKR20180312046500004
Disallow /view/AKR20001016000500007
Disallow /view/AKR20120627179800004
Disallow /view/AKR20120627179851004
Disallow /view/AKR20090217198200051
Disallow /view/AKR20200612149500005
Disallow /view/AKR20121210065200061
Disallow /view/AKR20121210099600061
Disallow /view/AKR20180323024000033
Disallow /view/AKR20121018033100014
Disallow /view/AKR20210225119251001
Disallow /view/AKR20210225119200001
Disallow /view/AKR20210225155200005
Disallow /view/AKR20111228151200061
Disallow /view/AKR20210528145800065
Disallow /view/AKR20210420149500051
Disallow /view/AKR20210420149551051
Disallow /view/AKR20071018085900004
Disallow /view/AKR20070709049600004
Disallow /view/AKR20080124092800004
Disallow /view/AKR20150728117000060
Disallow /view/AKR20100414090000017
Disallow /view/AKR20200428055400004
Disallow /view/MYH20140829007500038
Disallow /view/MYH20161104017200038
Disallow /view/MYH20121211002300038
Disallow /view/MYH20180323010400038
Disallow /view/PYH20191203158600013
Disallow /view/PYH20190918134800013
Disallow /view/PYH20190918134900013
Disallow /view/PYH20210225267400013
Disallow /view/IIS20110401000200365
Disallow /view/AKR20221115124100505

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

chatgpt-user

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.yna.co.kr/news-sitemap3.xml
sitemap https://www.yna.co.kr/news-sitemap4.xml
sitemap https://www.yna.co.kr/news-sitemap5.xml
sitemap https://www.yna.co.kr/news-sitemap6.xml
sitemap https://www.yna.co.kr/photo-sitemap.xml
sitemap https://www.yna.co.kr/graphic-sitemap.xml
sitemap https://www.yna.co.kr/video-sitemap.xml

Comments

  • 구글 바드 | 2023-10-10
  • 챗GPT | 2023-10-10
  • 챗GPT : 플러그인 차단 | 2023-11-20
  • Common Crawl : AI봇의 교육 목적으로 사용 | 2023-11-20
  • Anthropic PBC : 인공지능 스타트업 회사 | 2023-11-20
  • omgili,omgilibot : LLM에 훈련데이터 판매 | 2023-11-20
  • Facebook : 페이스북의 음성 인식 기술 학습용 | 2023-11-20
  • DaumWebMasterTool:d7750dcff82f089a70dbe0492c006d6441efbefa00ad389d65aebf4f9f8db353:1LhwNPgBqwmAlu7m7K9Fyg==