koreabest.io
robots.txt

Robots Exclusion Standard data for koreabest.io

Resource Scan

Scan Details

Site Domain koreabest.io
Base Domain koreabest.io
Scan Status Failed
Failure StageFetching resource.
Failure ReasonServer returned a server error.
Last Scan2024-09-30T08:28:14+00:00
Next Scan 2024-11-29T08:28:14+00:00

Last Successful Scan

Scanned2024-08-08T08:26:04+00:00
URL https://koreabest.io/robots.txt
Domain IPs 104.26.4.85, 104.26.5.85, 172.67.68.122, 2606:4700:20::681a:455, 2606:4700:20::681a:555, 2606:4700:20::ac43:447a
Response IP 104.26.5.85
Found Yes
Hash 127ffe2f6e9682d226df230485f1dfe641a6bf7aaafbfbfae5428eb9c5567f95
SimHash 6d4d083464b3

Groups

*

Rule Path
Allow /post/issue
Allow /post/humor
Allow /post/nsfw
Allow /post/story
Allow /post/soccer
Allow /post/wild
Allow /post/board
Allow /sitemap.xml
Allow /rss.xml
Allow /robots.txt
Disallow /image/

Other Records

Field Value
sitemap https://koreabest.ai/sitemap.xml

Comments

  • DaumWebMasterTool:37b777256fcb4bf4038f4fbbd47e7b57ba9c6e42f2f897c6599cf992b9a68da5:Km/sKIfYo3qmCx1/7jTOtQ==