chtoday.co.kr
robots.txt

Robots Exclusion Standard data for chtoday.co.kr

Resource Scan

Scan Details

Site Domain chtoday.co.kr
Base Domain chtoday.co.kr
Scan Status Ok
Last Scan2024-05-28T00:18:55+00:00
Next Scan 2024-06-04T00:18:55+00:00

Last Scan

Scanned2024-05-28T00:18:55+00:00
URL https://chtoday.co.kr/robots.txt
Redirect https://www.christiantoday.co.kr/robots.txt
Redirect Domain www.christiantoday.co.kr
Redirect Base christiantoday.co.kr
Domain IPs 13.209.242.0
Redirect IPs 13.209.242.0
Response IP 13.209.242.0
Found Yes
Hash 384170f6ccae91cba141b5b1b66f2a1a7d3f41ce8ba70991b422897c7ee76333
SimHash 630e41868f35

Groups

*

Rule Path
Allow /
Disallow /admin/
Disallow /*?utm_source=*
Disallow /*?utm_referrer=*
Disallow /*?fbclid=*
Disallow /*?click_type=*
Disallow /*?compatible=*
Disallow /*?sfns=*
Disallow /*?tap_is_link=*
Disallow /*?dable=*
Disallow /*?amp=*

Other Records

Field Value
crawl-delay 30

Other Records

Field Value
sitemap http://www.christiantoday.co.kr/sitemaplist.php