mediatoday.co.kr
robots.txt
Robots Exclusion Standard data for mediatoday.co.kr
Resource Scan
Scan Details
| Site Domain | mediatoday.co.kr |
| Base Domain | mediatoday.co.kr |
| Scan Status | Ok |
| Last Scan | 2024-11-13T12:07:49+00:00 |
| Next Scan | 2024-11-20T12:07:49+00:00 |
Last Scan
| Scanned | 2024-11-13T12:07:49+00:00 |
| URL | https://mediatoday.co.kr/robots.txt |
| Redirect | https://www.mediatoday.co.kr/robots.txt |
| Redirect Domain | www.mediatoday.co.kr |
| Redirect Base | mediatoday.co.kr |
| Domain IPs | 118.67.134.242 |
| Redirect IPs | 27.96.133.33, 49.50.169.88 |
| Response IP | 27.96.133.33 |
| Found | Yes |
| Hash | e5f73fdf09a82a780d6fa67f3c22b2ed8b0cf3e89948884de938b443c8d50626 |
| SimHash | 694760c54293 |
Groups
*
| Rule | Path |
|---|---|
| Disallow | /bbs/ |
| Disallow | /rss/ |
| Disallow | /Autobox/ |
| Disallow | /tv/ |
| Disallow | /paoin/ |
| Disallow | /admin/ |
| Disallow | /blog/ |
| Disallow | /member/ |
| Disallow | /pop_up/ |
| Disallow | /banner/ |
| Disallow | /com/ |
| Disallow | /bannerManager/ |
| Disallow | /event/ |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.mediatoday.co.kr/sitemap.xml |
Comments