stock.mt.co.kr
robots.txt

Robots Exclusion Standard data for stock.mt.co.kr

Resource Scan

Scan Details

Site Domain stock.mt.co.kr
Base Domain mt.co.kr
Scan Status Ok
Last Scan2024-11-15T10:00:27+00:00
Next Scan 2024-11-22T10:00:27+00:00

Last Scan

Scanned2024-11-15T10:00:27+00:00
URL https://stock.mt.co.kr/robots.txt
Redirect https://www.mt.co.kr/robots.txt
Redirect Domain www.mt.co.kr
Redirect Base mt.co.kr
Domain IPs 61.100.4.214
Redirect IPs 104.18.30.220, 104.18.31.220
Response IP 104.18.30.220
Found Yes
Hash 67dbb224894bb6707a7ba21cde3c008fd794c64bddc8da04c20c958c269927bb
SimHash 60564b40c6b5

Groups

googlebot

Rule Path
Allow /$
Allow /index.php

googlebot-news

Rule Path
Allow /$
Allow /index.php

googlebot-image

Rule Path
Allow /$
Allow /index.php

googlebot-video

Rule Path
Allow /$
Allow /index.php

mediapartners-google

Rule Path
Allow /$
Allow /index.php

popin_agent

Rule Path
Allow /$
Allow /index.php

bingbot

Rule Path
Allow /$
Allow /index.php

msnbot

Rule Path
Allow /$
Allow /index.php

msnbot-media

Rule Path
Allow /$
Allow /index.php

bingpreview

Rule Path
Allow /$
Allow /index.php

facebot

Rule Path
Allow /$
Allow /index.php

yeti

Rule Path
Allow /$
Allow /index.php

facebookexternalhit/1.1

Rule Path
Allow /$
Allow /index.php

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /$
Allow /index.php

twitterbot

Rule Path
Allow /$
Allow /index.php

google search console

Rule Path
Allow /$
Allow /index.php

googlebot/2.1

Rule Path
Allow /$
Allow /index.php

googlebot-smartphone

Rule Path
Allow /$
Allow /index.php

grapeshot

Rule Path
Allow /
Allow /index.php

*

Rule Path
Allow /$
Allow /index.php
Allow /ads.txt
Disallow /

anthropic-ai

Rule Path
Disallow /

bytespider

Rule Path
Disallow /

ccbot

Rule Path
Disallow /

claudebot

Rule Path
Disallow /

claude-web

Rule Path
Disallow /

cohere-ai

Rule Path
Disallow /

dataforseobot

Rule Path
Disallow /

diffbot

Rule Path
Disallow /

facebookbot

Rule Path
Disallow /

google-extended

Rule Path
Disallow /

gptbot

Rule Path
Disallow /

imagesiftbot

Rule Path
Disallow /

omgili

Rule Path
Disallow /

omgilibot

Rule Path
Disallow /

perplexitybot

Rule Path
Disallow /

wrtnbot

Rule Path
Disallow /

semrushbot

Rule Path
Disallow /

ahrefsbot

Rule Path
Disallow /

blexbot

Rule Path
Disallow /

dotbot

Rule Path
Disallow /

criteobot

Rule Path
Disallow /

Other Records

Field Value
sitemap https://www.mt.co.kr/b2b/mt_news_google.xml
sitemap https://www.mt.co.kr/sitemap.xml

Comments

  • Robots for www.mt.co.kr
  • ETC
  • Disallow
  • SiteMap
  • DaumWebMasterTool:9763cbfc0b9b4407e0b2caab4d0316b17c504155997a07b0fddb7c12ac4547fc:Q4NPkvO1hYLac9d2XA+e1w==