segyetimes.co.kr
robots.txt

Robots Exclusion Standard data for segyetimes.co.kr

Resource Scan

Scan Details

Site Domain segyetimes.co.kr
Base Domain segyetimes.co.kr
Scan Status Ok
Last Scan2024-10-05T18:49:43+00:00
Next Scan 2024-10-12T18:49:43+00:00

Last Scan

Scanned2024-10-05T18:49:43+00:00
URL http://segyetimes.co.kr/robots.txt
Domain IPs 49.236.149.65, 49.50.169.93
Response IP 49.236.149.65
Found Yes
Hash afde241677f28ddc8d8dd3e143c5b5252ecfd0599a62d46778ebc3d0e06b5e9a
SimHash 63565f1146f5

Groups

googlebot

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

googlebot-image

Rule Path
Allow /

googlebot-mobile

Rule Path
Allow /

mediapartners-google

Rule Path
Allow /

googlebot-news

Rule Path
Allow /

facebot

Rule Path
Allow /

bingbot

Rule Path
Allow /

facebookexternalhit/1.1

Rule Path
Allow /

twitterbot

Rule Path
Allow /

msnbot

Rule Path
Allow /

msnbot-media

Rule Path
Allow /

yeti

Rule Path
Allow /

daumoa

Rule Path
Allow /

popin_agent

Rule Path
Allow /

google search console

Rule Path
Allow /

googlebot/2.1

Rule Path
Allow /

googlebot-smartphone

Rule Path
Allow /

*

Rule Path
Allow /

Other Records

Field Value
sitemap https://www.segye.com/Sitemap_index.xml
sitemap https://www.segye.com//sitemap_img_index.xml