How marvel420-code/voxmate_ai_assitant works
VoxMate’s main workflow starts with face authentication, then launches a LiveKit voice assistant that uses prompt-defined behavior and registered tools to answer requests or perform actions. The tool suite covers weather, web search, email, and browser-based YouTube and Instagram access. Face matching uses local authorized images and DeepFace; the assistant uses Google’s realtime model through LiveKit. The README describes these product capabilities; implementation links below are limited to relationships visible in the excerpts.
Main entry points: tools.py Tool suite · face_auth_deepface.py Face authentication · agent.py Assistant definition · prompts.py Assistant prompts
Components 21
Startup and access
- App launcher
agent.py - Face authentication
face_auth_deepface.py - Authorized images
face_auth_deepface.py
Assistant runtime
- LiveKit entrypoint
agent.py - Assistant definition
agent.py - Assistant prompts
prompts.py
Assistant tools
- Tool suite
tools.py - Weather lookup
tools.py - Web search
tools.py - Email sending
tools.py - YouTube access
tools.py - Instagram access
tools.py
External integrations
- Webcam
- DeepFace
- LiveKit session
- Google realtime model
- wttr.in
- DuckDuckGo search
- Gmail SMTP
- Microsoft Edge
Other components
- User
Connections 21
- User → App launcher: starts
README.md - App launcher → Face authentication: authenticates first
agent.py - Face authentication → Authorized images: loads images
face_auth_deepface.py - Face authentication → Webcam: captures frames
face_auth_deepface.py - Face authentication → DeepFace: verifies faces
face_auth_deepface.py - App launcher → LiveKit entrypoint: starts worker
agent.py - LiveKit entrypoint → Assistant definition: starts session
agent.py - Assistant definition → Assistant prompts: uses instructions
agent.py - Assistant definition → Tool suite: registers tools
agent.py - LiveKit entrypoint → LiveKit session: starts and connects
agent.py - Assistant definition → Google realtime model: configures model
agent.py - Tool suite → Weather lookup: provides lookup
tools.py - Tool suite → Web search: provides search
tools.py - Tool suite → Email sending: provides sending
tools.py - Tool suite → YouTube access: provides access
tools.py - Tool suite → Instagram access: provides access
tools.py - Weather lookup → wttr.in: requests forecast
tools.py - Web search → DuckDuckGo search: runs search
tools.py - Email sending → Gmail SMTP: sends via SMTP
tools.py - YouTube access → Microsoft Edge: opens video
tools.py - Instagram access → Microsoft Edge: opens site
tools.py