How vellum-ai/vellum-assistant works
Vellum Assistant is a personal AI assistant that can run locally or on a managed platform, reached through desktop, web, mobile, voice, and messaging channels. A typical interaction arrives through a channel or gateway, is handled by the assistant runtime, and can use memory, tools, and provider-backed inference to produce a reply or take an action. The graph also preserves documented identity, proactive notifications, workflows, and plugin capabilities. Several core modules are named in the source index but not excerpted; their internal links are therefore omitted or marked unverified.
Main entry points: conversation-query-routes.ts Conversation Runtime · loop.ts Agent Loop · connections.ts Provider Connections · inbound-pipeline.ts Inbound Email
Components 28
Assistant Runtime
- Conversation Runtime
assistant/src/runtime/routes/conversation-query-routes.ts - Agent Loop
assistant/src/agent/loop.ts - Computer-Use Tools
assistant/src/api/computer-use-tool.ts - Plugin Pipeline
assistant/src/plugins/pipeline.ts
Memory & Intelligence
- Memory Ingestion
assistant/src/plugins/defaults/memory/src/memory-ingest-routes.ts - Local Embeddings
assistant/src/persistence/embeddings/embedding-runtime-manager.ts - Proactive Notifications
assistant/src/notifications/decision-engine.ts - Workflow Engine
assistant/src/workflows/engine.ts
Channels & Integrations
- Inbound Email
gateway/src/email/inbound-pipeline.ts - Inbound Handler
gateway/src/handlers/handle-inbound.ts - Webhook Pipeline
gateway/src/webhook-pipeline.ts - Runtime Client
gateway/src/runtime/client.ts - Messaging Channels
assistant/src/channels/config.ts - Voice Calls
assistant/src/calls/call-controller.ts
Platform Services
- Config Loader
assistant/src/config/loader.ts - LLM Config
assistant/src/config/schemas/llm.ts - SQLite Database
assistant/src/persistence/db-connection.ts - Connection Resolution
assistant/src/providers/connection-resolution.ts - Provider Auth
assistant/src/providers/inference/auth.ts - Provider Connections
assistant/src/providers/inference/connections.ts - Model Catalog
assistant/src/providers/model-catalog.ts - Provider Registry
assistant/src/providers/registry.ts - Vellum Routing
assistant/src/providers/vellum-model-routing.ts - Route Policy
assistant/src/runtime/auth/route-policy.ts - Logging
assistant/src/util/logger.ts - Platform Paths
assistant/src/util/platform.ts
User Clients
- Desktop, Web & Mobile
clients/web/src/routes.tsx
Other components
- User
Connections 26
- User → Desktop, Web & Mobile: uses
README.md - Desktop, Web & Mobile → Conversation Runtime: sends messages
- Messaging Channels → Conversation Runtime: delivers messages
README.md - Inbound Email → Inbound Handler: forwards message
gateway/src/email/inbound-pipeline.ts - Inbound Email → Webhook Pipeline: processes result
gateway/src/email/inbound-pipeline.ts - Webhook Pipeline → Runtime Client: resets conversation
gateway/src/webhook-pipeline.ts - Conversation Runtime → Config Loader: loads config
assistant/src/runtime/routes/conversation-query-routes.ts - Conversation Runtime → Agent Loop: dispatches turn
- Agent Loop → Computer-Use Tools: invokes tools
README.md - Agent Loop → Plugin Pipeline: uses plugins
README.md - Conversation Runtime → Route Policy: checks access
README.md - Conversation Runtime → LLM Config: validates settings
assistant/src/runtime/routes/conversation-query-routes.ts - Conversation Runtime → Memory Ingestion: exposes ingestion
assistant/src/plugins/defaults/memory/src/memory-ingest-routes.ts - Memory Ingestion → SQLite Database: persists memory
- Conversation Runtime → Local Embeddings: uses local embeddings
README.md - Conversation Runtime → Proactive Notifications: triggers reminders
README.md - Conversation Runtime → Workflow Engine: runs workflows
README.md - Conversation Runtime → Connection Resolution: resolves provider
assistant/src/runtime/routes/inference-profiles-routes.ts - Connection Resolution → Provider Connections: uses connections
assistant/src/providers/connection-resolution.ts - Provider Connections → SQLite Database: reads and writes
assistant/src/providers/inference/connections.ts - Provider Auth → Model Catalog: derives providers
assistant/src/providers/inference/auth.ts - Provider Registry → Provider Connections: invalidates cache
assistant/src/providers/inference/connections.ts - Provider Auth → Vellum Routing: uses routing rules
assistant/src/providers/inference/auth.ts - Conversation Runtime → Voice Calls: supports voice
README.md - Config Loader → Platform Paths: resolves config path
assistant/src/config/loader.ts - Logging → Platform Paths: uses platform utilities
assistant/src/util/logger.ts