h21.hani.co.kr
robots.txt
Robots Exclusion Standard data for h21.hani.co.kr
Resource Scan
Scan Details
| Site Domain | h21.hani.co.kr |
| Base Domain | hani.co.kr |
| Scan Status | Ok |
| Last Scan | 2024-09-19T06:30:00+00:00 |
| Next Scan | 2024-10-19T06:30:00+00:00 |
Last Scan
| Scanned | 2024-09-19T06:30:00+00:00 |
| URL | https://h21.hani.co.kr/robots.txt |
| Domain IPs | 138.113.112.18, 138.113.199.19, 138.113.53.41 |
| Response IP | 138.113.53.41 |
| Found | Yes |
| Hash | 13c88d288e61dd604999abc995bbd3b658c866fa8cd979659aedf33c5864719a |
| SimHash | 250bde61ccd9 |
Groups
*
No rules defined. All paths allowed.
Other Records
| Field | Value |
|---|---|
| crawl-delay | 600 |
daum
| Rule | Path |
|---|---|
| Disallow | /hani_manager/ |
| Disallow | /hani_manager2/ |
| Disallow | /hani_manager3/ |
| Disallow | /service_inc/ |
| Disallow | /service_inc2/ |
| Disallow | /reply/ |
| Disallow | /h21_manager/ |
| Disallow | /h21_service_inc/ |
| Disallow | /reply_h21/ |
| Disallow | /*%26cline%3D |
| Disallow | /arti/politics/politics_general/512764.html |
| Disallow | /arti/politics/politics_general/512659.html |
| Disallow | /arti/society/society_general/474032.html |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 60 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://h21.hani.co.kr/arti/RSS/sitemap.xml |