asiae.co.kr
robots.txt
Robots Exclusion Standard data for asiae.co.kr
Resource Scan
Scan Details
| Site Domain | asiae.co.kr |
| Base Domain | asiae.co.kr |
| Scan Status | Ok |
| Last Scan | 2024-05-25T22:21:35+00:00 |
| Next Scan | 2024-06-01T22:21:35+00:00 |
Last Scan
| Scanned | 2024-05-25T22:21:35+00:00 |
| URL | https://asiae.co.kr/robots.txt |
| Redirect | https://www.asiae.co.kr/robots.txt |
| Redirect Domain | www.asiae.co.kr |
| Redirect Base | asiae.co.kr |
| Domain IPs | 183.111.172.9 |
| Redirect IPs | 183.111.172.9 |
| Response IP | 183.111.172.9 |
| Found | Yes |
| Hash | 25a4fa3cfe109f9aea5c710eb260c2770c7c5fc5dbc5befc1bf5d40a7c65d4cb |
| SimHash | 41111b514452 |
Groups
*
| Rule | Path |
|---|---|
| Allow | / |
| Disallow | /search |
| Disallow | /photo/photo_list.htm |
| Disallow | /article/2023052308473862036 |
| Disallow | /article/2023111416414310710 |
Other Records
| Field | Value |
|---|---|
| sitemap | https://www.asiae.co.kr/news/sitemap-cross-submit.xml |
| sitemap | https://www.asiae.co.kr/news/sitemap-cross-submit_p.xml |
| sitemap | https://www.asiae.co.kr/news/sitemap-xml.htm |
| sitemap | https://www.asiae.co.kr/news/sitemap-xml_new.htm |
| sitemap | https://www.asiae.co.kr/news/sitemap_google_news.xml |
| sitemap | https://www.asiae.co.kr/news/sitemap_image.xml |
| sitemap | https://www.asiae.co.kr/news/sitemap_new.xml |
| sitemap | https://www.asiae.co.kr/news/sitemap_new_p.xml |
| sitemap | https://www.asiae.co.kr/news/sitemap_video.xml |