From 47dd61f6d36a3287b67025e15caa03eb6f830195 Mon Sep 17 00:00:00 2001 From: Rob Colbert Date: Tue, 19 May 2026 16:35:01 -0400 Subject: [PATCH] docs: update CHANGE.md and README.md for upcoming patch release - CHANGE.md: Added entries for May 18 (token economics, chat export, UI fixes) and May 19 (Qdrant semantic search, vector embeddings, model/test fixes) - README.md: Added Qdrant to prerequisites and architecture diagram, documented token economics, semantic search, and chat export features --- CHANGE.md | 31 +++++++++++++++++++++++++++++++ README.md | 24 ++++++++++++++++++++++-- 2 files changed, 53 insertions(+), 2 deletions(-) diff --git a/CHANGE.md b/CHANGE.md index c4e5ec6..f89ce01 100644 --- a/CHANGE.md +++ b/CHANGE.md @@ -4,6 +4,37 @@ This document tracks all significant changes to Gadget Code, organized by date. --- +## 2026-05-19 (Monday) + +**Qdrant Semantic Search and Vector Embeddings** + +Implemented Qdrant-powered semantic search over chat history with full embedding pipeline, including Qdrant and LangChain configuration, vector dimension passthrough for both Ollama and OpenAI, and a new search API endpoint with frontend search input component. Also fixed Mongoose syncIndexes errors across all models and improved drone-session test isolation. + +### Changes: +- **Semantic Search**: Implemented Qdrant vector search over chat history with embedding pipeline and search API endpoint. +- **Embeddings**: Added Qdrant and embedding model configuration; added `@langchain/textsplitters` for text vector processing; fixed vector dimension passthrough for Ollama and OpenAI. +- **Frontend**: Added SearchInput and ChatSearchResults components; integrated search into ChatSessionView. +- **Models**: Removed `syncIndexes` from all Mongoose models (caused duplicate index errors); mocked DB in drone-session tests. +- **Fixes**: Fixed auto-scroll, search input errors, and backend error handling; logging and formatting cleanup. +- **Build**: Added clean script. + +--- + +## 2026-05-18 (Sunday) + +**Token Economics, Chat Export, and UI Layout Fixes** + +Implemented token economics with real API token extraction from OpenAI responses, stats propagation through the session pipeline, and a context window fuel gauge. Added chat_export agent tool for markdown/JSON session export. Fixed home sidebar layout for independent scrolling sections. + +### Changes: +- **Token Economics**: Implemented real API token extraction from OpenAI responses, stats propagation, and context window fuel gauge with auto-update. +- **Logging**: Added DtpLog logging of all OpenAI API responses with raw response object capture. +- **Chat Export**: Added `chat_export` agent tool for session export in markdown and JSON formats. +- **UI**: Fixed home sidebar flex column layout with independent scrolling sections; added `lucide-react` icons. +- **Config**: Added Qdrant and embedding model config types. + +--- + ## 2026-05-17 (Sunday) **Release Hardening, Subagent Improvements, and Workspace Intelligence** diff --git a/README.md b/README.md index 8785c88..d66466e 100644 --- a/README.md +++ b/README.md @@ -41,6 +41,8 @@ pnpm dev │ │ │ │ Socket.IO │ MongoDB │ Files │ JWT Auth │ Redis │ Git + │ │ Qdrant │ + │ │ │ ``` ### How It Works @@ -117,6 +119,7 @@ pnpm cli user password user@example.com newpassword - pnpm 10+ - MongoDB on `localhost:27017` - Redis on `localhost:6379` +- Qdrant on `localhost:6333` (for semantic search) - SSL certificates in `ssl/` directory (for dev servers) ### Build @@ -196,6 +199,23 @@ npx tsx scripts/seed-test-drones.ts - Model/mode selection per session - Session statistics (tool calls, file ops, subagents) +### Token Economics + +- Real API token extraction from OpenAI and Ollama responses +- Token usage stats propagated through session pipeline +- Context window fuel gauge with auto-update + +### Semantic Search + +- Qdrant-powered vector search over chat history +- Embedding pipeline with Ollama and OpenAI support +- Configurable embedding model and vector dimensions + +### Chat Export + +- Export chat sessions as markdown or JSON +- Agent tool for automated session export + ### Workspace Management - Each drone manages a workspace directory @@ -253,5 +273,5 @@ Apache 2.0 — See [LICENSE](./LICENSE) for details. --- -**Status:** v1.0.1 — First release. Self-hosted agentic engineering platform with local/self-hosted AI model support, complete Chat Session UI, subagent processing, and workspace management. -**Last Updated:** May 17, 2026 +**Status:** v1.0.1 — Self-hosted agentic engineering platform with local/self-hosted AI model support, complete Chat Session UI, subagent processing, workspace management, token economics, and Qdrant semantic search. +**Last Updated:** May 19, 2026