Clone
6
Current WiP
gramps edited this page 2026-07-13 11:19:55 -07:00

⇦ Back to Home

cAIc Current WiP Backlog

Last updated: 2026-07-13 Owner: Gramps Scope: Active roadmap items and backlog.

Roadmap N: AMQP Cluster Nervous System [COMPLETE]

All 15 tasks are done. Final commit: f0689ac feat: Roadmap N — AMQP cluster nervous system complete.

Backlog

  • B1 — Context loss in follow-up questions (investigation)
  • B2 — Bang-prefixed (!) search routing
  • B3 — Docker distribution (planning doc at docker.md)
  • B4 — RAG Corpus Management UI (NEXT) — browse, search, edit, delete individual RAG entries. Backend endpoints at routers/rag_admin.py, frontend panel in templates/index.html
  • B5 — Default model auto-pull on first start — download the default GGUF model from HuggingFace (or configured mirror) if models/ is empty when llama-server first starts. Configurable via CAIC_DEFAULT_MODEL_URL or similar. Needs a startup probe that checks model availability and a download-with-progress endpoint.
  • HTTPS / reverse proxy (Caddy)
  • Conversation search/filter and export tooling
  • B6 — Waterfall direction toggle — add a setting to flip message order between top-down (newest at top, waterfall) and bottom-up (newest at bottom, standard chat). Needs localStorage persistence and a UI toggle (maybe in settings modal or topbar).
  • B7 — Apple Silicon worker support — no Apple hardware needed for implementation; llama.cpp Metal backend exposes the same OpenAI-compat API. Changes:
    • gpu.py — add get_gpu_stats_macos() path using system_profiler SPDisplaysDataType for VRAM, sysctl hw.memsize for unified memory
    • hardware.pyplatform.system() == "Darwin" branch skips rocm-smi, calls macOS VRAM probe instead
    • node_agent/agent.py — detect macOS, register with platform: darwin, backend: metal
    • routers/models.pyget_gpu_stats() dispatch to Metal stats on macOS
    • Tests — add test fixture mocking a darwin worker registration + ping/pong; coordinator treats it identically to CUDA/ROCm workers
  • Keyboard shortcuts, retry button, source-link polish

Maintenance Rules

  • Keep this file as the single source of truth for roadmap tracking.
  • Update as work starts or completes.