ktimes.com
robots.txt

Robots Exclusion Standard data for ktimes.com

Resource Scan

Scan Details

Site Domain ktimes.com
Base Domain ktimes.com
Scan Status Ok
Last Scan2024-11-15T14:15:46+00:00
Next Scan 2024-11-22T14:15:46+00:00

Last Scan

Scanned2024-11-15T14:15:46+00:00
URL http://ktimes.com/robots.txt
Domain IPs 3.35.203.120, 3.39.197.141
Response IP 3.39.197.141
Found Yes
Hash 98d351c8bd6ef255d67628b315f3436628134868f7a2af6ef49553cf8f2bf272
SimHash 413c1014af95

Groups

*

Rule Path
Disallow /naver
Disallow /AxForm
Disallow /Ajax
Disallow /aspnet_client
Disallow /PDF
Disallow /events
Disallow /Archives
Disallow /www/events
Disallow /www/bak
Disallow /www/etc
Disallow /www/src
Disallow /www/NIE
Disallow /www/LTNIE
Disallow /www/LT
Disallow /www/LT/timescall
Disallow /www/news/include
Disallow /www/news/include/print.asp
Disallow /www/category
Disallow /board
Disallow /chart
Disallow /Create_File
Disallow /LT
Disallow /manager
Disallow /member
Disallow /koreatime_admin
Disallow /koreatime_adminV2
Disallow /www/nation/2020/07/113_292890.html
Disallow /www/nation/2020/07/176_292890.html
Disallow /www/common/printpreviews.asp
Disallow /www/nation/2019/09/www/sublist_662.html
Disallow /www/NIE/common/nviewPage.asp?idx=1492&nmode=3
Disallow /www2/Event
Disallow /www/registration/myscrap_add.asp
Disallow /www/news/community
Disallow /www/news/bizfocus

amazonbot

Rule Path
Disallow /

awariorssbot
awariosmartbot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

magpie-crawler

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

peer39_crawler

Rule Path
Disallow /

brightbot

Rule Path
Disallow /

twitterbot

Rule Path
Allow /*?*smid=

Other Records

Field Value
sitemap https://www.koreatimes.co.kr/site_map/news/news.xml
sitemap https://www.koreatimes.co.kr/site_map/month/month.xml
sitemap https://www.koreatimes.co.kr/site_map/northkorea/northkorea.xml
sitemap https://www.koreatimes.co.kr/site_map/business/business.xml
sitemap https://www.koreatimes.co.kr/site_map/finance/finance.xml
sitemap https://www.koreatimes.co.kr/site_map/lifestyle/lifestyle.xml
sitemap https://www.koreatimes.co.kr/site_map/entertainment/entertainment.xml
sitemap https://www.koreatimes.co.kr/site_map/opinion/opinion.xml
sitemap https://www.koreatimes.co.kr/site_map/sports/sports.xml
sitemap https://www.koreatimes.co.kr/site_map/world/world.xml
sitemap https://www.koreatimes.co.kr/site_map/video/video.xml
sitemap https://www.koreatimes.co.kr/site_map/photos/photos.xml