news2day.co.kr
robots.txt

Robots Exclusion Standard data for news2day.co.kr

Resource Scan

Scan Details

Site Domain news2day.co.kr
Base Domain news2day.co.kr
Scan Status Ok
Last Scan2024-11-09T09:47:04+00:00
Next Scan 2024-11-16T09:47:04+00:00

Last Scan

Scanned2024-11-09T09:47:04+00:00
URL https://news2day.co.kr/robots.txt
Domain IPs 49.236.150.236, 49.50.168.145
Response IP 49.236.150.236
Found Yes
Hash df1802dc70c73968596ce4807aa97bc8b963df415bd65da8fa7b34e809bd656d
SimHash 6800531057f5

Groups

*

Rule Path
Disallow /print/*

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

popin_agent

Rule Path
Allow /

bingbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

bingpreview

Rule Path
Allow /

facebot

Rule Path
Allow /

yeti

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

facebookexternalhit/1.1 (+http://www.facebook.com/externalhit_uatext.php)

Rule Path
Allow /

twitterbot

Rule Path
Allow /

grapeshot

Rule Path
Disallow

google search console

Rule Path
Allow /

googlebot/2.1

Rule Path
Allow /

googlebot-smartphone

Rule Path
Allow /

*

Rule Path
Disallow /