B4 RAG Corpus Management UI + AGENTS.md → ai.md rename
- Backend: GET/DELETE/PATCH /api/rag/point/{id}, GET /api/rag/points
(paginated, semantic search, source filter, sort)
- Frontend: admin-only RAG modal with stats bar, search, paginated table,
per-row edit (re-embed) and delete, bulk flush with double confirm
- 14 new tests, 214 total passing
- AGENTS.md → ai.md (tool-agnostic), CLAUDE.md now references ai.md
- Bump v0.21.0 → v0.22.0
This commit is contained in:
gramps
@@ -1,8 +1,8 @@
|
||||
# CLAUDE.md
|
||||
# ai.md — Project Context
|
||||
|
||||
This file provides guidance to Claude Code (claude.ai/code) when working with code in this repository.
|
||||
Detailed project context, work state, architecture, and configuration have moved to [`ai.md`](ai.md). This file is kept for backward compatibility — the canonical reference is `ai.md`.
|
||||
|
||||
## Running the App
|
||||
## Quick start
|
||||
|
||||
```bash
|
||||
# Development
|
||||
@@ -21,74 +21,3 @@ sudo systemctl restart caic
|
||||
./venv/bin/pip install -r requirements.txt
|
||||
# Also requires: psutil jinja2 python-multipart pypdf (not in requirements.txt)
|
||||
```
|
||||
|
||||
## Architecture
|
||||
|
||||
Modular FastAPI app — `app.py` wires routers, middleware, and lifespan. SQLite database auto-created at `caic.db` on first run. No build step, single `templates/index.html`.
|
||||
|
||||
### Request Flow: `/api/chat`
|
||||
|
||||
1. User message saved to DB → conversation created if new
|
||||
2. `process_remember_command()` intercepts "remember that..." / "forget about..." first
|
||||
3. Optional `upload_context_id` → fetches document text from `upload_context` table, injects `[ATTACHED DOCUMENT]` into system prompt
|
||||
4. `build_system_prompt()` assembles: profile + FTS5 memory search + Qdrant RAG + preset + skills + uploaded doc
|
||||
5. Streamed to llama-server (`/v1/chat/completions`, `stream: true`, `logprobs: true`) via SSE
|
||||
6. **Auto web search trigger**: if perplexity > 15.0 OR response matches `REFUSAL_PATTERNS`, re-queries with SearXNG results
|
||||
7. Final response saved to DB; SSE `done` event sent with perplexity + tokens/sec
|
||||
|
||||
### Request Flow: `/api/search` (explicit search)
|
||||
|
||||
Bypasses perplexity/refusal — queries SearXNG directly then asks llama-server to summarize results.
|
||||
|
||||
### Request Flow: `/api/upload`
|
||||
|
||||
Multipart file upload → PDF/text extraction + chunking → optional Qdrant upsert + SQLite context storage (1hr expiry). Supports `mode=(context|ingest|both)`. Images upload as storage only — model cannot process image content.
|
||||
|
||||
### Request Flow: `/api/ingest`
|
||||
|
||||
Bearer-token-authenticated terminal RAG hook. Accepts raw text, chunks via `chunk_text()`, embeds via Ollama `/api/embeddings`, upserts to Qdrant.
|
||||
|
||||
### Memory System
|
||||
|
||||
FTS5 virtual table (`memories`) in SQLite. `search_memories()` uses BM25 ranking. `process_remember_command()` intercepts "remember that..." / "forget about..." before the message reaches the model and returns a confirmation string.
|
||||
|
||||
### Key Constants (`config.py`)
|
||||
|
||||
- `LLAMA_SERVER_BASE` — `http://192.168.50.108:8081` (coordinator llama-server, RPC offloads to worker GPU)
|
||||
- `SEARXNG_BASE` — `http://localhost:8888`
|
||||
- `QDRANT_URL` — `http://192.168.50.108:6333` (Qdrant on coordinator)
|
||||
- `TRIAGE_BASE` — `http://127.0.0.1:8083/v1` (Phi-4-mini)
|
||||
- `AMQP_URL` — `amqp://caic:{pw}@localhost:5672/caic` (RabbitMQ, pw read from `~/.caic_amqp_secret`)
|
||||
- `PERPLEXITY_THRESHOLD` — `15.0`
|
||||
- `EMBED_URL` — `http://192.168.50.210:11434/api/embeddings` (Ollama on worker)
|
||||
- `VERSION` — current version string
|
||||
|
||||
### External Services
|
||||
|
||||
| Service | Required | Port |
|
||||
|---------|----------|------|
|
||||
| **llama-server** (coordinator) | Yes | 8081 + RPC :50052 (worker GPU) |
|
||||
| **Phi-4-mini** (triage) | No | 8083 |
|
||||
| **SearXNG** | No | 8888 |
|
||||
| **RabbitMQ** (coordinator) | No | 5672 — AMQP broker |
|
||||
| **wttr.in** | No | weather shortcut |
|
||||
| **rocm-smi** | No | AMD GPU stats |
|
||||
| **Qdrant** (coordinator) | No | 6333 — RAG vector search |
|
||||
| **Ollama** (worker) | No | 11434 — embeddings only |
|
||||
|
||||
### Database
|
||||
|
||||
`get_db()` opens a new connection per request (no pool). `init_db()` runs at startup via FastAPI `lifespan`. Tables: `conversations`, `messages`, `settings`, `profile` (singleton id=1), `memories` (FTS5), `upload_context`. Default settings seeded but never overwritten.
|
||||
|
||||
### SSE Protocol
|
||||
|
||||
All streaming endpoints yield `data: {json}\n\n`. Key event shapes:
|
||||
- `{token, conversation_id}` — streaming token
|
||||
- `{searching: true}` — web search triggered
|
||||
- `{search_results: N}` — N results retrieved
|
||||
- `{done: true, perplexity, tokens_per_sec, searched?}` — terminal event
|
||||
- `{error: "...", error_key: "..."}` — error with incident key
|
||||
|
||||
### Deployment
|
||||
|
||||
Runs as systemd service under user `caic`, working directory `/opt/caic`. Logs via syslog (`journalctl -u caic`). Version bumps via git tag + commit, deployed via `git pull && systemctl restart caic`.
|
||||
|
||||
Reference in New Issue
Block a user