tenasia.hankyung.com
robots.txt

Robots Exclusion Standard data for tenasia.hankyung.com

Resource Scan

Scan Details

Site Domain tenasia.hankyung.com
Base Domain hankyung.com
Scan Status Ok
Last Scan2024-05-09T03:09:37+00:00
Next Scan 2024-06-08T03:09:37+00:00

Last Scan

Scanned2024-05-09T03:09:37+00:00
URL https://tenasia.hankyung.com/robots.txt
Domain IPs 211.53.214.27
Response IP 211.53.214.27
Found Yes
Hash 127ef489bf9ccd1b61d01df86862e4aeb8d5d1af5b3c55303be1614c1f9da03f
SimHash e82543d247f4

Groups

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

bingpreview

Rule Path
Allow /

facebot

Rule Path
Allow /

yeti

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /

twitterbot

Rule Path
Allow /

*

Rule Path
Disallow /html/
Disallow /test/
Disallow /include/
Disallow /incfile/
Disallow /data/

Other Records

Field Value
sitemap https://tenasia.hankyung.com/sitemap/latest-article
sitemap https://tenasia.hankyung.com/sitemap/daily-article
sitemap https://tenasia.hankyung.com/sitemap/monthly-article