How aadhithiyan107/voxedge works
VoxEdge continuously captures microphone audio, gates and evaluates rolling windows with local keyword spotting, then starts post-detection audio streaming to optional remote ASR for transcripts. FastAPI exposes session controls and status while broadcasting live events to the React dashboard. The graph separates capture/verification, ASR, API/state contracts, and UI. Source excerpts support the principal runtime calls; training and model artifacts are excluded as development assets. README documents capabilities beyond the sampled source, so only evidenced relationships are connected.
Main entry points: stream_manager.py Audio Stream Manager · service.py Deepgram Streaming · state.py Application State · routes.py REST Session API
Components 14
Audio and Detection
- Audio Stream Manager
backend/audio/stream_manager.py - Keyword Engine
backend/kws/service.py - KWS Interface
backend/kws/interface.py
Speech Recognition
- ASR Interface
backend/asr/interface.py - Deepgram Streaming
backend/asr/service.py
Backend and Contracts
- FastAPI App
backend/main.py - REST Session API
backend/api/routes.py - Application State
backend/core/state.py - Runtime Settings
backend/core/config.py - Event Contracts
backend/schemas/events.py
Dashboard
- React Dashboard
frontend/src/App.jsx
Other components
- Microphone
- Deepgram Service
- Dashboard User
Connections 20
- Microphone → Audio Stream Manager: provides audio
README.md - Audio Stream Manager → Keyword Engine: evaluates windows
backend/audio/stream_manager.py - Audio Stream Manager → Deepgram Streaming: starts stream
backend/audio/stream_manager.py - Audio Stream Manager → Deepgram Streaming: sends audio
backend/audio/stream_manager.py - Deepgram Streaming → Deepgram Service: streams audio
README.md - FastAPI App → Audio Stream Manager: starts and stops
backend/main.py - FastAPI App → REST Session API: mounts routes
backend/main.py - REST Session API → Audio Stream Manager: controls session
backend/api/routes.py - REST Session API → Application State: reads status
backend/api/routes.py - FastAPI App → Application State: connects WebSocket
backend/main.py - Audio Stream Manager → Application State: updates state
backend/audio/stream_manager.py - Deepgram Streaming → Application State: updates transcript
backend/asr/service.py - Application State → Event Contracts: builds payloads
backend/core/state.py - Keyword Engine → KWS Interface: implements
backend/kws/service.py - Deepgram Streaming → ASR Interface: implements
backend/asr/service.py - Dashboard User → React Dashboard: uses dashboard
README.md - React Dashboard → REST Session API: fetches status and controls
frontend/src/App.jsx - Runtime Settings → Audio Stream Manager: configures capture
backend/audio/stream_manager.py - Runtime Settings → Keyword Engine: configures inference
backend/kws/service.py - Runtime Settings → Deepgram Streaming: configures provider
backend/asr/service.py