mtv.jtbc.joins.com
robots.txt

Robots Exclusion Standard data for mtv.jtbc.joins.com

Resource Scan

Scan Details

Site Domain mtv.jtbc.joins.com
Base Domain joins.com
Scan Status Failed
Failure StageFetching resource.
Failure ReasonRequest timed out.
Last Scan2025-10-29T16:30:41+00:00
Next Scan 2025-12-28T16:30:41+00:00

Last Successful Scan

Scanned2025-08-08T02:15:14+00:00
URL https://mtv.jtbc.joins.com/robots.txt
Redirect https://mtv.jtbc.co.kr/robots.txt
Redirect Domain mtv.jtbc.co.kr
Redirect Base jtbc.co.kr
Domain IPs 218.145.68.187
Redirect IPs 211.218.152.108
Response IP 211.218.152.108
Found Yes
Hash 585a63b6bf4a7c7aa2011293fe60d9944fb4527a10f3ee1434248bddab7cbaa8
SimHash f4930951e1c2

Groups

*
googlebot

Rule Path
Disallow /search
Disallow /error
Disallow /pay
Disallow /my

bingbot

Rule Path
Disallow /search
Disallow /error
Disallow /pay
Disallow /my

yeti

Rule Path
Disallow /search
Disallow /error
Disallow /pay
Disallow /my

gptbot

Rule Path
Disallow /

anthropic-ai

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

google-cloudvertexbot

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

applebot-extended

Rule Path
Disallow /

meta-externalagent

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

duckassistbot

Rule Path
Disallow /

ai2bot

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

kangaroo bot

Rule Path
Disallow /

pangubot

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

youbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

timpibot

Rule Path
Disallow /

velenpublicwebcrawler

Rule Path
Disallow /

webzio-extended

Rule Path
Disallow /

scrapy

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

semrushbot-sa

Rule Path
Disallow /

semrushbot-ba

Rule Path
Disallow /

Other Records

Field Value
sitemap https://jtbc.co.kr/sitemap/index_sitemap.xml