How sankar-s-r/voice_agent works
Voice Agent is a real-time, streaming voice assistant. A user speaks over WebRTC; Pipecat’s pipeline performs turn detection, transcription, LLM response generation, and speech synthesis before returning audio to the user. A separate observer monitors turn and speech events and injects a natural filler if the response is delayed. The README documents the service choices and streaming design; source excerpts show pipeline wiring and fallback behavior, but do not expose the internals of Pipecat or the external providers.
Main entry points: bot.py WebRTC Transport · fallback.py Fallback Observer
Components 14
Voice Conversation
- WebRTC Transport
server/bot.py - Turn Detection
server/bot.py - Streaming STT
server/bot.py - Conversation Context
server/bot.py - Streaming LLM
server/bot.py - Streaming TTS
server/bot.py - Audio Output
Pipeline Orchestration
- Pipeline Worker
server/bot.py - Pipeline Runner
server/bot.py
Fallback Engagement
- Fallback Observer
server/fallback.py
External Providers
- Deepgram
- Groq
- Cartesia
Other components
- Voice User
Connections 15
- Voice User → WebRTC Transport: sends audio
README.md - WebRTC Transport → Streaming STT: streams input
server/bot.py - Streaming STT → Turn Detection: transcribes
server/bot.py - Turn Detection → Streaming LLM: forwards turn
server/bot.py - Conversation Context → Streaming LLM: provides context
server/bot.py - Streaming LLM → Streaming TTS: streams response
README.md - Streaming TTS → WebRTC Transport: sends audio
server/bot.py - WebRTC Transport → Audio Output: plays audio
README.md - Pipeline Worker → WebRTC Transport: runs pipeline
server/bot.py - Pipeline Runner → Pipeline Worker: runs worker
server/bot.py - Pipeline Worker → Fallback Observer: notifies observer
server/bot.py - Fallback Observer → Pipeline Worker: queues filler
server/fallback.py - Streaming STT → Deepgram: transcribes with
server/bot.py - Streaming LLM → Groq: generates with
server/bot.py - Streaming TTS → Cartesia: synthesizes with
server/bot.py