⇦ Back to Home
cAIc Current WiP Backlog
Last updated: 2026-07-13
Owner: Gramps
Scope: Active roadmap items and backlog.
Roadmap N: AMQP Cluster Nervous System [COMPLETE]
All 15 tasks are done. Final commit: f0689ac feat: Roadmap N — AMQP cluster nervous system complete.
Backlog
- B1 — Context loss in follow-up questions (investigation)
- B2 — Bang-prefixed (
!) search routing
- B3 — Docker distribution (planning doc at
docker.md)
- B4 — RAG Corpus Management UI (NEXT) — browse, search, edit, delete individual RAG entries. Backend endpoints at
routers/rag_admin.py, frontend panel in templates/index.html
- B5 — Default model auto-pull on first start — download the default GGUF model from HuggingFace (or configured mirror) if
models/ is empty when llama-server first starts. Configurable via CAIC_DEFAULT_MODEL_URL or similar. Needs a startup probe that checks model availability and a download-with-progress endpoint.
- HTTPS / reverse proxy (Caddy)
- Conversation search/filter and export tooling
- B6 — Waterfall direction toggle — add a setting to flip message order between top-down (newest at top, waterfall) and bottom-up (newest at bottom, standard chat). Needs
localStorage persistence and a UI toggle (maybe in settings modal or topbar).
- B7 — Apple Silicon worker support — no Apple hardware needed for implementation; llama.cpp Metal backend exposes the same OpenAI-compat API. Changes:
gpu.py — add get_gpu_stats_macos() path using system_profiler SPDisplaysDataType for VRAM, sysctl hw.memsize for unified memory
hardware.py — platform.system() == "Darwin" branch skips rocm-smi, calls macOS VRAM probe instead
node_agent/agent.py — detect macOS, register with platform: darwin, backend: metal
routers/models.py — get_gpu_stats() dispatch to Metal stats on macOS
- Tests — add test fixture mocking a darwin worker registration + ping/pong; coordinator treats it identically to CUDA/ROCm workers
- Keyboard shortcuts, retry button, source-link polish
Maintenance Rules
- Keep this file as the single source of truth for roadmap tracking.
- Update as work starts or completes.