How andrewkochulab/jarvis-dashboard works
J.A.R.V.I.S. is a cross-platform AI command dashboard; its principal mobile voice workflow sends audio or text over WebSocket, transcribes audio, runs Claude, streams responses and optionally synthesizes speech. The dashboard also monitors sessions and analytics and provides configurable productivity widgets. The graph combines documented capabilities with relationships visible in the supplied source excerpts; unsampled widget, iOS and platform internals are represented only at supported subsystem boundaries.
Main entry points: server-factory.js Server assembly · voice-pipeline.js Voice orchestration · tts-manager.js Speech queue · DashboardView.swift iOS voice dashboard
Components 27
Dashboard clients
- iOS voice dashboard
ios/JarvisApp/Views/DashboardView.swift - Voice Command widget
src/widgets/voice-command - Mobile network client
src/services/network-client.js
Voice interaction
- Audio capture session
companion/modules/audio.js - Speech transcription
companion/modules/transcriber.js - Voice orchestration
companion/modules/voice-pipeline.js - Claude execution
companion/modules/claude-runner.js - Speech queue
companion/modules/tts/tts-manager.js - Piper synthesis
companion/modules/tts/piper-engine.js - macOS Say synthesis
companion/modules/tts/say-engine.js - TTS engine callbacks
companion/modules/tts/base-engine.js
Companion server
- Server entry
companion/server.js - Server assembly
companion/modules/server-factory.js - Client authentication
companion/modules/auth.js - Message routing
companion/modules/message-router.js - Message handlers
companion/modules/handlers.js - Connection state
companion/modules/connection-handler.js - WebSocket protocol
companion/modules/protocol.js
Monitoring and widgets
- Live sessions
src/widgets/live-sessions/index.js - Session monitoring
src/services/session-manager.js - Activity analytics
src/widgets/activity-analytics/index.js - Productivity widgets
src/widgets/focus-timer/index.js
Platform integration
- macOS desktop app
macos/src-tauri/src/lib.rs - Platform adapters
shared/bridge/platform-adapter.js - iOS web bridge
ios/JarvisApp/Bridge/WebViewBridge.swift
Other components
- Mobile user
- Claude CLI, Whisper, TTS tools
Connections 31
- Mobile user → iOS voice dashboard: uses
- iOS voice dashboard → Voice Command widget: hosts voice UI
- Voice Command widget → Mobile network client: sends commands
- Mobile network client → Server entry: connects by WebSocket
- Server entry → Server assembly: starts
companion/server.js - Server assembly → Client authentication: configures
companion/modules/server-factory.js - Server assembly → Message routing: registers routes
companion/modules/server-factory.js - Server assembly → Connection state: creates per client
companion/modules/server-factory.js - Server assembly → Voice orchestration: creates per client
companion/modules/server-factory.js - Server assembly → WebSocket protocol: parses messages
companion/modules/server-factory.js - Message routing → Message handlers: dispatches
companion/modules/server-factory.js - Message handlers → Audio capture session: creates and appends audio
companion/modules/handlers.js - Message handlers → Voice orchestration: starts processing
companion/modules/handlers.js - Voice orchestration → Speech transcription: transcribes audio
companion/modules/voice-pipeline.js - Voice orchestration → Claude execution: runs prompt
companion/modules/voice-pipeline.js - Voice orchestration → WebSocket protocol: builds response messages
companion/modules/voice-pipeline.js - Voice orchestration → Speech queue: queues response speech
companion/modules/voice-pipeline.js - Connection state → Claude execution: initializes
companion/modules/connection-handler.js - Connection state → Speech queue: initializes when enabled
companion/modules/connection-handler.js - Speech queue → Piper synthesis: selects engine
companion/modules/tts/tts-manager.js - Speech queue → macOS Say synthesis: selects or falls back
companion/modules/tts/tts-manager.js - Piper synthesis → TTS engine callbacks: inherits callbacks
companion/modules/tts/piper-engine.js - macOS Say synthesis → TTS engine callbacks: inherits callbacks
companion/modules/tts/say-engine.js - Claude execution → Claude CLI, Whisper, TTS tools: invokes Claude CLI
- Speech transcription → Claude CLI, Whisper, TTS tools: uses Whisper
- Piper synthesis → Claude CLI, Whisper, TTS tools: spawns Piper binary
companion/modules/tts/piper-engine.js - macOS Say synthesis → Claude CLI, Whisper, TTS tools: spawns say
companion/modules/tts/say-engine.js - Live sessions → Session monitoring: monitors sessions
- Activity analytics → Session monitoring: summarizes activity
- macOS desktop app → Platform adapters: uses shared adapters
- iOS voice dashboard → iOS web bridge: hosts web view
ios/JarvisApp/Views/DashboardView.swift