gadget/gadget-code
Rob Colbert 56f35a2fdf feat: Qdrant semantic search over chat history
Adds vector-based semantic search across all chat sessions using Qdrant.
When a ChatTurn finishes, its content is chunked, embedded, and upserted
to a Qdrant collection. A search API and UI components enable searching
at user, project, and session scope.

Phase 1 — Configuration & Dependencies
- Add port/apiKey to GadgetCodeConfig.qdrant type
- Uncomment and update qdrant section in YAML config example
- Add qdrant config passthrough in env.ts
- Add @qdrant/js-client-rest dependency

Phase 2 — AI Embedding API (@gadget/ai)
- Add IAiEmbeddingResponse interface and abstract embeddings() to AiApi
- Implement embeddings() in OllamaAiApi (client.embeddings)
- Implement embeddings() in OpenAiApi (client.embeddings.create)
- Export IAiEmbeddingResponse from package index

Phase 3 — Backend Vector Store Service
- Create VectorStoreService (ingestTurn, search, removeTurnPoints)
- Hook fire-and-forget ingest after turn.save() in drone-session
- Register VectorStoreService in service startup/shutdown

Phase 4 — Backend Search API
- Create POST /api/v1/search controller with userId enforcement
- Batch-hydrate results from MongoDB (user, project, session, turn)
- Register search route in v1 API router

Phase 5 — Frontend Search Components
- SearchInput: debounced input with lucide-react icons
- ChatSearchResults: modal with score badges, metadata, loading states
- DroneSelectionModal: drone picker for sessions without a drone
- Add searchApi and ISearchResult to API client
- Add search to Home (global), ProjectManager (project), ChatSessionView (session)
- Add id=turn-{turnId} to ChatTurn for scroll targeting
- Scroll-to-turn from search result selection and router state
- Show DroneSelectionModal when no drone available
- Add Select Drone button in ChatSessionView sidebar
2026-05-19 14:28:30 -04:00
..
.vscode created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
assets/icon created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
data/prompts plan tool updates 2026-05-17 14:09:24 -04:00
docs Phase 2: SubProcess observability in DroneManager and DroneInspector 2026-05-14 13:52:59 -04:00
frontend feat: Qdrant semantic search over chat history 2026-05-19 14:28:30 -04:00
nginx created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
scripts move from Types.ObjectId to GadgetId (a string) 2026-05-01 14:31:00 -04:00
src feat: Qdrant semantic search over chat history 2026-05-19 14:28:30 -04:00
ssl created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
supervisor created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
tests fix: update code-session tests to expect reality 2026-05-17 18:53:50 -04:00
types created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
.gitignore created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
AGENTS.md fixes 2026-05-13 06:38:29 -04:00
deploy created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
gadget-code.code-workspace created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
LICENSE created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
package.json feat: Qdrant semantic search over chat history 2026-05-19 14:28:30 -04:00
playwright.config.ts created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
pnpm-lock.yaml prompt draft save/restore in Chat Session view 2026-05-17 17:39:34 -04:00
pnpm-workspace.yaml created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
README.md make reasoning effort configurable; remove sign up concept 2026-05-08 11:40:30 -04:00
release created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
tsconfig.json created by merging gadget-code and gadget-drone 2026-04-28 09:20:37 -04:00
vitest.config.ts make reasoning effort configurable; remove sign up concept 2026-05-08 11:40:30 -04:00

Gadget Code

A modern self-hosted and open source Agentic Engineering Environment. Gadget Code is a hackable TypeScript/Node.js web application - and application development framework - built with Express, React, Vite, and Tailwind CSS.

Gadget Code is a Gab-first initiative. It is most well-tested and tuned for use with Gab.ai as your "Big Brain" compute provider. However, it is designed to be easily adaptable for use with other compute providers as well as your own local Ollama, vLLM, or other OpenAI or Ollama API-compatible setup.

Architecture

┌─────────────────────────────────────────────────────────────┐
│                    Vite Dev Server (HTTPS)                  │
│                    https://code-dev.g4dge7.com:5174         │
│                                                             │
│  ┌───────────┐  ┌───────────┐  ┌───────────┐                │
│  │   /auth   │  │   /api    │  │  static   │                │
│  │   proxy   │  │  proxy    │  │  files    │                │
│  └────┬──────┘  └────┬──────┘  └───────────┘                │
│       │              │                                      │
│       ▼              ▼                                      │
│  ┌─────────────────────────────┐                            │
│  │   Backend (HTTP)            │                            │
│  │   http://localhost:3443     │                            │
│  │   - Express API             │                            │
│  │   - Socket.io               │                            │
│  │   - Session (Redis)         │                            │
│  │   - MongoDB                 │                            │
│  └─────────────────────────────┘                            │
└─────────────────────────────────────────────────────────────┘

Tech Stack

  • Frontend: React 19, Vite 8, Tailwind CSS 4, Socket.io Client
  • Backend: Express 5, TypeScript, Socket.io Server
  • Database: MongoDB (Mongoose)
  • Cache/Session: Redis (ioredis + connect-redis)
  • File Storage: MinIO
  • Testing: Vitest, Playwright

Getting Started

Prerequisites

  • Node.js 22+
  • pnpm 10+
  • MongoDB running on localhost:27017
  • Redis running on localhost:6379
  • SSL certificates in ssl/ directory

Installation

pnpm install

Development

# Start both backend and frontend
pnpm dev:backend   # Backend on http://localhost:3443
pnpm dev:frontend # Frontend on https://localhost:5174

Build

pnpm build          # Build backend + frontend
pnpm build:backend # Build TypeScript only
pnpm build:frontend # Build React/Vite only

Testing

pnpm test            # Run vitest unit tests
npx playwright test  # Run E2E integration tests

Scripts

Your environment can be managed with the following package.json scripts and npx commands.

Command Description
pnpm build Build backend + frontend
pnpm test Run vitest unit tests
npx playwright test Run E2E tests
pnpm dev:backend Start backend (port 3443)
pnpm dev:frontend Start frontend (port 5174)
pnpm start Start production build

Environment Variables

# Required
DTP_USER_PASSWORD_SALT="your-password-salt"
DTP_JWT_SECRET="your-jwt-secret"
DTP_SESSION_SECRET="your-session-secret"

# MongoDB
DTP_MONGODB_HOST="localhost"
DTP_MONGODB_DATABASE="gadget-code"

# Redis
DTP_REDIS_HOST="localhost"
DTP_REDIS_PORT="6379"

# HTTPS
DTP_HTTPS="enabled"
DTP_HTTPS_HOST="localhost"
DTP_HTTPS_PORT="3443"
DTP_HTTPS_KEY_FILE="/path/to/ssl/key.pem"
DTP_HTTPS_CRT_FILE="/path/to/ssl/cert.pem"

 # Session
 DTP_SESSION_TRUST_PROXY="enabled"
 DTP_SESSION_COOKIE_SECURE="enabled"
 DTP_SESSION_COOKIE_SAMESITE="strict"

Features

  • User authentication (sign in, sign out)
  • JWT-based session management
  • RESTful API structure
  • Socket.io real-time communication
  • File upload support (MinIO)
  • Email notifications
  • Tailwind CSS frontend with dark theme

Project Structure

/src
  /config          # Environment configuration
  /controllers    # Express route handlers
  /lib            # Core utilities
  /models         # Mongoose models
  /services       # Business logic
/frontend
  /src
    /components  # React components
    /pages       # React pages
    /lib         # Frontend utilities
  /public        # Static assets
  vite.config.ts # Vite configuration
/tests
  /e2e           # Playwright tests

API Endpoints

Method Endpoint Description
POST /auth/sign-in Authenticate
GET /auth/sign-out Sign out
GET /api/v1/user Get current user

License

SEE LICENSE IN LICENSE