How marvis-ai/marvis works
Marvis is a privacy-first desktop AI assistant: users ask through an always-on-top bar, optionally attach a recent screen frame, and receive streamed provider responses; or start meeting capture and view live transcripts and rolling summaries. React views invoke the Rust core, which owns sensitive capture, audio, model access, keys, and local persistence. The README also documents onboarding, permissions, hotkeys, deep links, and provider failover. Relationships for unsampled subsystems below are limited to documented workflows; source-level evidence is cited where available.
Main entry points: ask.rs Ask orchestration · listen.rs Listen orchestration · Bar.tsx Overlay bar · commands.ts Command bridge
Components 20
Desktop interface
- Overlay bar
apps/native/src/views/Bar.tsx - Ask and chat
apps/native/src/components/ChatSection.tsx - Listen card
apps/native/src/components/ListenSection.tsx - Settings and setup
apps/native/src/components/prefs/Onboarding.tsx - Command bridge
apps/native/src/lib/commands.ts
Assistant core
- Ask orchestration
apps/native/src-tauri/src/ask.rs - Screen capture
apps/native/src-tauri/src/capture/controller.rs - LLM providers
apps/native/src-tauri/src/llm/mod.rs - Provider configuration
apps/native/src-tauri/src/config.rs - Local API keys
apps/native/src-tauri/src/keystore.rs - Session database
apps/native/src-tauri/src/storage.rs
Meeting intelligence
- Audio capture
apps/native/src-tauri/src/audio/recorder.rs - Listen orchestration
apps/native/src-tauri/src/listen.rs - Speech recognition
apps/native/src-tauri/src/stt/mod.rs - Meeting summaries
apps/native/src-tauri/src/listen.rs
Platform and setup
- Overlay windows
apps/native/src-tauri/src/windows/mod.rs - Permission gates
apps/native/src-tauri/src/permissions/mod.rs - Global hotkey
apps/native/src-tauri/src/hotkey.rs - Deep links
apps/native/src-tauri/src/deeplink.rs
Other components
- Desktop user
Connections 21
- Desktop user → Overlay bar: asks through
README.md - Overlay bar → Command bridge: invokes commands
README.md - Command bridge → Ask orchestration: starts Ask
apps/native/src/lib/commands.ts - Ask orchestration → Screen capture: reads recent frame
README.md - Ask orchestration → LLM providers: streams request
README.md - Ask orchestration → Session database: persists conversation
README.md - LLM providers → Provider configuration: uses providers
apps/native/src-tauri/src/config.rs - Provider configuration → Local API keys: uses API keys
- Desktop user → Listen card: starts listening
README.md - Listen card → Command bridge: invokes commands
README.md - Listen orchestration → Audio capture: captures channels
README.md - Listen orchestration → Speech recognition: transcribes audio
README.md - Listen orchestration → Session database: stores transcript
README.md - Listen orchestration → Meeting summaries: creates summaries
README.md - Meeting summaries → LLM providers: requests summaries
- Desktop user → Settings and setup: configures app
README.md - Settings and setup → Command bridge: invokes commands
README.md - Overlay windows → Overlay bar: hosts view
apps/native/src-tauri/src/windows/mod.rs - Permission gates → Overlay bar: gates access
README.md - Global hotkey → Overlay windows: surfaces bar
- Deep links → Ask orchestration: fires Ask
README.md