Commit Graph

3 Commits

Author SHA1 Message Date
itsamejms a69d7caefb fix: RAG — UTF-8 chunk boundary, source dedupe, embed-model guard + reindex
- chunk(): byte splits that landed mid multibyte char silently dropped
  the whole chunk (accented/CJK lore). Back the boundary off to a char
  boundary; regression test included.
- add_document(): DELETE the source first — re-adding a file no longer
  doubles its chunks.
- chunks now record their embed_model (ALTER TABLE migration for old
  DBs); search skips chunks from a different model; rag_list reports it;
  new rag_reindex re-embeds everything, surfaced in the Lore panel as a
  mismatch banner with a one-click Reindex.
2026-09-06 23:25:22 +01:00
itsamejms b89a39ec9d building out the components, updating the UI in overview and adding a little sqlite viewer 2026-07-17 09:31:51 +01:00
itsamejms a24f3615e0 working through the plan + UI/ UX 2026-07-12 22:13:43 +01:00