How rahulverma9449/jarvis-voice-assistance works
Jarvis is a local desktop voice assistant with a companion dashboard/API. The main workflow is voice or dashboard input → command routing → a skill or AI response → spoken/displayed result, with history and related local data recorded. The README emphasizes voice, speech, web search, desktop apps, system tasks, and question answering; the code also exposes dashboard capabilities such as notes, memory, food scanning, image generation, media, and Atlassian actions. Some UI request details and unsampled skill internals are omitted; edges reflect only visible calls or API usage.
Main entry points: backend.py Assistant API · command_router.py Command Router · main.py Voice Runtime · skills Command Skills
Components 19
User Interaction
- Dashboard UI
frontend/src/App.jsx - Workspace Panel
frontend/src/components/WorkspacePanel.jsx - Voice Runtime
Jarvis/main.py - Speech I/O
Jarvis/core/speech.py - Assistant API
backend.py
Command Orchestration
- Command Router
Jarvis/core/command_router.py - Capability Catalog
Jarvis/core/capabilities.py
Assistant Capabilities
- Command Skills
Jarvis/skills - AI Providers
Jarvis/ai/llm.py - AI Proxy
jarvis-proxy/server.py
Local State
- Command History
Jarvis/core/history.py - Browser Data
Jarvis/core/browser_datastore.py - Assistant Memory
Jarvis/ai/memory.py - Workspace Store
Jarvis/core/workspace_store.py
External Integrations
- Market API
Jarvis/core/market_api.py - AI Services
- Desktop OS
- Web Services
Other components
- User
Connections 21
- User → Dashboard UI: enters commands
- User → Voice Runtime: speaks commands
- Dashboard UI → Assistant API: calls API
- Workspace Panel → Assistant API: requests workspace
- Voice Runtime → Speech I/O: listens and speaks
- Voice Runtime → Command Router: routes command
- Assistant API → Command Router: routes command
- Assistant API → Capability Catalog: reads capabilities
- Assistant API → Command History: reads and clears
- Assistant API → Assistant Memory: reads and updates
- Assistant API → Browser Data: reads records
- Assistant API → Market API: includes router
- Command Router → Command Skills: dispatches command
- Command Router → AI Providers: asks fallback
- Command Router → Command History: records result
- Command Router → Browser Data: records work queries
- Command Router → Assistant Memory: dispatches memory skill
- Command Skills → Desktop OS: controls computer
- Command Skills → Web Services: uses web services
- AI Providers → AI Services: requests completion
- AI Proxy → AI Services: requests completion