How xiaotianfotos/indexed works
Indexed is a local-first multimodal library for explicitly added files and user-captured web video. People and agents configure an embedding backend, scan assets into model-isolated vector indexes, then search and return source paths, timestamps, and text. The map covers the documented Dashboard, CLI, browser capture, local storage, and Apple-native embedding paths. Several route and storage implementations are unsampled; edges are limited to documented relationships or visible imports and calls.
Main entry points: index.ts Local HTTP service · ingest.ts Asset ingestion · asset-library.ts Asset library · ingest-test.ts Ingest test runner
Components 25
User access
- Dashboard
apps/dashboard/src/main.ts - CLI
apps/cli/src/index.ts - Browser extension
apps/extension/src/service-worker.ts - Video capture
apps/extension/src/content-script.ts
Application service
- Local HTTP service
apps/server/src/index.ts - Profiles and config
packages/config/src/index.ts - Shared contracts
packages/contracts/src/index.ts - Ingest test runner
apps/server/src/ingest-test.ts
Ingest and search
- Asset ingestion
packages/core/src/ingest.ts - Asset library
packages/core/src/asset-library.ts - Asset chunks
packages/core/src/asset-chunks.ts - Document assets
packages/core/src/document-assets.ts - Ingest performance
packages/core/src/ingest-performance.ts - Local file search
packages/core/src/search-assets.ts - Library operations
packages/core/src/library.ts - Local vector store
packages/clients/src/local-vectors.ts
Embedding backends
- Embedding transport
packages/clients/src/embedding-transport.ts - Apple backend adapter
packages/apple-embedding-backend/src/index.ts - Native service
native/apple-embedding/swift/Sources/IndexedAppleEmbeddingService/ServiceMain.swift - Inference router
native/apple-embedding/swift/Sources/AppleEmbeddingCore/ServiceRouter.swift - MLX embedding engine
native/apple-embedding/swift/Sources/AppleEmbeddingCore/MLXWeMMEngine.swift - Core ML decoder
native/apple-embedding/swift/Sources/AppleEmbeddingCore/CoreMLDecoderBundle.swift - Vision patches
native/apple-embedding/swift/Sources/AppleEmbeddingCore/VisionPatches.swift
Other components
- Local user
- AI agent
Connections 30
- Local user → Dashboard: uses
README.md - Local user → CLI: uses
README.md - AI agent → CLI: invokes
README.md - Local user → Video capture: selects video
README.md - Video capture → Browser extension: sends captures
- Dashboard → Local HTTP service: calls API
- CLI → Local HTTP service: uses service
apps/cli/src/index.ts - Browser extension → Local HTTP service: sends requests
- Local HTTP service → Profiles and config: loads profiles
apps/server/src/index.ts - Local HTTP service → Shared contracts: uses protocol
- Local HTTP service → Asset ingestion: dispatches ingest
apps/server/src/index.ts - Local HTTP service → Local file search: dispatches search
apps/server/src/index.ts - Local HTTP service → Embedding transport: forwards embeddings
apps/server/src/index.ts - Local HTTP service → Apple backend adapter: manages runtime
apps/server/src/index.ts - Local HTTP service → Ingest test runner: runs tests
apps/server/src/index.ts - Asset ingestion → Asset library: indexes assets
packages/core/src/asset-library.ts - Asset library → Asset chunks: uses chunks
packages/core/src/asset-library.ts - Asset library → Document assets: uses extraction
packages/core/src/asset-library.ts - Asset library → Ingest performance: records throughput
packages/core/src/asset-library.ts - Asset ingestion → Local vector store: stores vectors
- Local file search → Asset library: reads assets
packages/core/src/search-assets.ts - Local file search → Library operations: searches library
packages/core/src/search-assets.ts - Asset ingestion → Embedding transport: requests embeddings
packages/core/src/ingest.ts - Apple backend adapter → Native service: starts helper
- Native service → Inference router: creates router
native/apple-embedding/swift/Sources/IndexedAppleEmbeddingService/ServiceMain.swift - Inference router → MLX embedding engine: routes inference
- MLX embedding engine → Core ML decoder: uses decoder
native/apple-embedding/swift/Sources/AppleEmbeddingCore/MLXWeMMEngine.swift - MLX embedding engine → Vision patches: prepares patches
native/apple-embedding/swift/Sources/AppleEmbeddingCore/MLXWeMMEngine.swift - Ingest test runner → Profiles and config: checks profile
apps/server/src/ingest-test.ts - Ingest test runner → Asset ingestion: scans library
apps/server/src/ingest-test.ts