chtoday.co.kr
robots.txt
Robots Exclusion Standard data for chtoday.co.kr
Resource Scan
Scan Details
| Site Domain | chtoday.co.kr |
| Base Domain | chtoday.co.kr |
| Scan Status | Ok |
| Last Scan | 2024-11-12T16:52:53+00:00 |
| Next Scan | 2024-11-19T16:52:53+00:00 |
Last Scan
| Scanned | 2024-11-12T16:52:53+00:00 |
| URL | https://chtoday.co.kr/robots.txt |
| Redirect | https://www.christiantoday.co.kr/robots.txt |
| Redirect Domain | www.christiantoday.co.kr |
| Redirect Base | christiantoday.co.kr |
| Domain IPs | 13.209.242.0 |
| Redirect IPs | 13.209.242.0 |
| Response IP | 13.209.242.0 |
| Found | Yes |
| Hash | 384170f6ccae91cba141b5b1b66f2a1a7d3f41ce8ba70991b422897c7ee76333 |
| SimHash | 630e41868f35 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /admin/ |
| Disallow | /*?utm_source=* |
| Disallow | /*?utm_referrer=* |
| Disallow | /*?fbclid=* |
| Disallow | /*?click_type=* |
| Disallow | /*?compatible=* |
| Disallow | /*?sfns=* |
| Disallow | /*?tap_is_link=* |
| Disallow | /*?dable=* |
| Disallow | /*?amp=* |
Other Records
| Field | Value |
|---|---|
| crawl-delay | 30 |
Other Records
| Field | Value |
|---|---|
| sitemap | http://www.christiantoday.co.kr/sitemaplist.php |