m.spoon.spotvnews.co.kr
robots.txt
Robots Exclusion Standard data for m.spoon.spotvnews.co.kr
Resource Scan
Scan Details
Site Domain | m.spoon.spotvnews.co.kr |
Base Domain | spotvnews.co.kr |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Request timed out. |
Last Scan | 2024-04-04T16:55:12+00:00 |
Next Scan | 2024-07-03T16:55:12+00:00 |
Last Successful Scan
Scanned | 2023-05-14T16:39:27+00:00 |
URL | http://m.spoon.spotvnews.co.kr/robots.txt |
Response IP | 121.125.77.157 |
Found | Yes |
Hash | 4d0d5c0120a40e58228d63b011b38c986628b3283d7ad987265dfbb9643d0f4b |
SimHash | 694520a44b93 |
Groups
*
Rule | Path |
---|---|
Disallow | /admin/ |
Disallow | /blog/ |
Disallow | /member/ |
Disallow | /pop_up/ |
Disallow | /banner/ |
Disallow | /com/ |
Disallow | /bannerManager/ |
Other Records
Field | Value |
---|---|
sitemap | http://www.intn.co.kr/sitemap.xml |