How katipally/openlive works
OpenLive is a local-first voice and vision layer for AI agents, delivered through desktop and web interfaces. A person starts a Chat call, speaks, and receives a spoken model or coding-agent response; Flow extends voice actions across apps, while Dictate types speech at the cursor. The README documents the on-device voice loop, camera/screen input, tools, skills, connectors, memory, and history. The graph includes those product branches and sampled internal layers; several service and UI links are documented capabilities, not verified call paths.
Main entry points: server.ts Local agent service · queries.ts App database · routes.ts Tool capabilities · route.ts History API
Components 23
Desktop and UI
- Desktop shell
apps/desktop/main.cjs - App interface
apps/web/src/app/page.tsx - Live call UI
apps/web/src/components/live/InCall.tsx - Flow mode
apps/web/src/components/flow/FlowHome.tsx - Dictate mode
apps/web/src/components/dictate/DictateHome.tsx
Voice and sessions
- Voice pipeline
apps/web/src/lib/live/pipelineConfig.ts - Live session
apps/web/src/lib/live/useLiveSession.ts - Flow runtime
apps/desktop/flow-runtime.cjs - Flow input
apps/desktop/flow-input.cjs
Agent capabilities
- Local agent service
services/agent/src/server.ts - Agent adapters
services/agent/src/agents/supervisor.ts - Tool capabilities
services/agent/src/capabilities/routes.ts - MCP connectors
services/agent/src/connectors/manager.ts - Skills
services/agent/src/skills/routes.ts - Memory
services/agent/src/memory/routes.ts - Native voice engines
services/agent/src/voice/engine.ts
Local state
- App database
packages/db/src/queries.ts - Flow session store
packages/flow-store/src/session.ts - History API
apps/web/src/app/api/history/route.ts
Device integration
- Native input
native/ol-input/src/coordinator.rs - Input hooks
native/ol-input/src/hook.rs
Other components
- Person
- Model or coding agent
Connections 29
- Person → Desktop shell: opens app
README.md - Person → App interface: uses modes
README.md - Desktop shell → App interface: shows UI
apps/desktop/main.cjs - Person → Live call UI: starts call
README.md - Live call UI → Live session: runs session
- Live session → Voice pipeline: uses voice loop
- Voice pipeline → Model or coding agent: sends transcript
README.md - Model or coding agent → Live call UI: returns response
README.md - Person → Flow mode: invokes Flow
README.md - Flow mode → Flow runtime: requests actions
- Flow runtime → Flow input: uses input
apps/desktop/flow-runtime.cjs - Flow input → Native input: types at cursor
- Native input → Input hooks: uses hooks
- Person → Dictate mode: dictates text
README.md - Dictate mode → Native input: inserts speech
- Local agent service → Agent adapters: manages agents
- Agent adapters → Model or coding agent: dispatches turns
README.md - Local agent service → Tool capabilities: serves tools
- Tool capabilities → MCP connectors: lists connector tools
services/agent/src/capabilities/routes.ts - Tool capabilities → App database: reads settings
services/agent/src/capabilities/routes.ts - Local agent service → Skills: serves skills
- Skills → App database: stores skill settings
services/agent/src/skills/routes.ts - Local agent service → Memory: serves memory
- Memory → App database: uses persistence
- Local agent service → Native voice engines: runs native speech
- Native voice engines → App database: reads model settings
services/agent/src/voice/engine.ts - History API → App database: reads chats
apps/web/src/app/api/history/route.ts - History API → Flow session store: reads retention
apps/web/src/app/api/history/route.ts - Person → History API: views sessions
README.md