koreabest.io
robots.txt
Robots Exclusion Standard data for koreabest.io
Resource Scan
Scan Details
Site Domain | koreabest.io |
Base Domain | koreabest.io |
Scan Status | Failed |
Failure Stage | Fetching resource. |
Failure Reason | Server returned a server error. |
Last Scan | 2024-09-30T08:28:14+00:00 |
Next Scan | 2024-11-29T08:28:14+00:00 |
Last Successful Scan
Scanned | 2024-08-08T08:26:04+00:00 |
URL | https://koreabest.io/robots.txt |
Domain IPs | 104.26.4.85, 104.26.5.85, 172.67.68.122, 2606:4700:20::681a:455, 2606:4700:20::681a:555, 2606:4700:20::ac43:447a |
Response IP | 104.26.5.85 |
Found | Yes |
Hash | 127ffe2f6e9682d226df230485f1dfe641a6bf7aaafbfbfae5428eb9c5567f95 |
SimHash | 6d4d083464b3 |
Groups
*
Rule | Path |
---|---|
Allow | /post/issue |
Allow | /post/humor |
Allow | /post/nsfw |
Allow | /post/story |
Allow | /post/soccer |
Allow | /post/wild |
Allow | /post/board |
Allow | /sitemap.xml |
Allow | /rss.xml |
Allow | /robots.txt |
Disallow | /image/ |
Other Records
Field | Value |
---|---|
sitemap | https://koreabest.ai/sitemap.xml |
Comments