coohex.github.io
robots.txt

Robots Exclusion Standard data for coohex.github.io

Resource Scan

Scan Details

Site Domain coohex.github.io
Base Domain coohex.github.io
Scan Status Ok
Last Scan2026-02-07T09:32:05+00:00
Next Scan 2026-02-14T09:32:05+00:00

Last Scan

Scanned2026-02-07T09:32:05+00:00
URL https://coohex.github.io/robots.txt
Domain IPs 185.199.108.153, 185.199.109.153, 185.199.110.153, 185.199.111.153, 2606:50c0:8000::153, 2606:50c0:8001::153, 2606:50c0:8002::153, 2606:50c0:8003::153
Response IP 185.199.111.153
Found Yes
Hash 431606f0e4886e56e462cdc0c499348f14106b8866a94a170d68b9ca3d5bedba
SimHash 69256ce2ee93

Groups

*

Rule Path
Disallow /update/

Other Records

Field Value
sitemap https://coohex.github.io/sitemap.xml

Comments

  • --- 真正的保护项 ---
  • 屏蔽后台和私有目录(这些不参与渲染)
  • Disallow: /admin/
  • Disallow: /backup/
  • Disallow: /private/
  • Disallow: /cgi-bin/
  • Disallow: /temp/
  • --- 性能项 ---
  • 屏蔽内部搜索结果页(防止无限路径导致爬虫掉进死循环)
  • Disallow: /search/
  • --- 资源项 ---
  • 允许抓取所有渲染必需资源
  • Allow: /assets/
  • --- Api项 ---