dtoday.co.kr
robots.txt
Robots Exclusion Standard data for dtoday.co.kr
Resource Scan
Scan Details
Site Domain | dtoday.co.kr |
Base Domain | dtoday.co.kr |
Scan Status | Ok |
Last Scan | 2024-11-13T09:02:14+00:00 |
Next Scan | 2024-11-20T09:02:14+00:00 |
Last Scan
Scanned | 2024-11-13T09:02:14+00:00 |
URL | https://dtoday.co.kr/robots.txt |
Redirect | https://www.dtoday.co.kr/robots.txt |
Redirect Domain | www.dtoday.co.kr |
Redirect Base | dtoday.co.kr |
Domain IPs | 118.67.129.28 |
Redirect IPs | 115.85.179.212, 49.50.168.122 |
Response IP | 49.50.168.122 |
Found | Yes |
Hash | 99b62ce756686dcf9c857f34230ee32b6802dfefc93d6215e344dd885e8ebd25 |
SimHash | e90170c65b92 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /blog/ |
Disallow | /member/ |
Disallow | /pop_up/ |
Disallow | /banner/ |
Disallow | /com/ |
Disallow | /bannerManager/ |
Disallow | /engine_yonhap/ |
Disallow | /search_yonhap/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.dtoday.co.kr/sitemap.xml |