dailian.co.kr
robots.txt

Robots Exclusion Standard data for dailian.co.kr

Resource Scan

Scan Details

Site Domain dailian.co.kr
Base Domain dailian.co.kr
Scan Status Ok
Last Scan2024-05-29T12:23:07+00:00
Next Scan 2024-06-05T12:23:07+00:00

Last Scan

Scanned2024-05-29T12:23:07+00:00
URL https://dailian.co.kr/robots.txt
Domain IPs 210.89.190.230
Response IP 210.89.190.230
Found Yes
Hash b8eeb8feff680e3b5c5b99e6a26021ca41ceb391fe35569db4af209a966aeb78
SimHash 902cb8a063b3

Groups

semrushbot

Rule Path
Disallow /

*

Rule Path
Disallow /login
Disallow /logout
Disallow /reporterlogin
Disallow /register
Disallow /commentList
Disallow /writeComment
Disallow /getComments
Disallow /editComment
Disallow /deleteComment
Disallow /likeComment
Disallow /hateComment
Disallow /sortComment
Disallow /likeNews
Disallow /sosoNews
Disallow /hateNews
Disallow /mobile/
Disallow /mobilelight/
Disallow /light/

Other Records

Field Value
crawl-delay 3600

Other Records

Field Value
sitemap https://center.dailian.co.kr/sitemap/newssitemap.xml