How dinh-huu-phuc/friday works
FRIDAY is a Windows-focused AI assistant with a local FastAPI interface and capabilities spanning conversational assistance, retrieval, vision, device control, and integrations. The main visible interaction path is a user sending chat over the UI WebSocket to the agent-console service; README also documents hands-free voice and external speech/LLM providers. The graph retains major subsystems named in the README and tree, but limits internal wiring to relationships supported by the sampled source or explicit documentation; unsampled subsystem paths are exact enclosing directories.
Main entry points: decision_engine.py Decision Engine · perception Perception Services · routes.py UI Chat Routes · agent_console Agent Console
Components 24
User Interaction
- UI Chat Routes
friday-tony-stark-demo/friday/src/UI/routes.py - Agent Console
friday-tony-stark-demo/friday/app/agent_console - Speech Services
friday-tony-stark-demo/friday/app/agent_console/tts_service.py
Assistant Reasoning
- Decision Engine
friday-tony-stark-demo/friday/runtime/decision_engine.py - RAG Pipeline
friday-tony-stark-demo/friday/core/rag/rag_pipeline.py - Language Manager
friday-tony-stark-demo/friday/language/manager.py
Vision And Spatial
- Camera Manager
friday-tony-stark-demo/friday/app/perception/camera/camera_manager.py - Perception Services
friday-tony-stark-demo/friday/app/perception - Scene Relations
friday-tony-stark-demo/friday/app/perception/relation/engine.py - Gesture Engine
friday-tony-stark-demo/friday/app/spatial/service/gesture_engine.py
Device Actions
- Computer Control
friday-tony-stark-demo/friday/app/computer - Browser Automation
friday-tony-stark-demo/friday/app/browser_automation/service.py - Sleep Display
friday-tony-stark-demo/friday/app/sleep_display/process_manager.py - Calendar Reminders
friday-tony-stark-demo/friday/app/calendar - Live Search
friday-tony-stark-demo/friday/app/research - Code Map
friday-tony-stark-demo/friday/app/code_map
External Integrations
- Social Connectors
friday-tony-stark-demo/friday/app/discord - Local Vision Model
- Supabase Storage
friday-tony-stark-demo/friday/core/db/services/supabase_storage.py
Other components
- User
- Chrome
- Speech Recognition
- Configured LLM
- Configured TTS
Connections 14
- User → UI Chat Routes: sends chat
- UI Chat Routes → Agent Console: dispatches chat
- Agent Console → Speech Services: uses speech
- User → Speech Recognition: provides voice
- Speech Recognition → Configured LLM: transcribes input
- Configured LLM → Configured TTS: generates reply
- Decision Engine → Language Manager: loads messages
- Decision Engine → RAG Pipeline: retrieves context
- Camera Manager → Perception Services: captures frames
- Perception Services → Scene Relations: infers relations
- Gesture Engine → Perception Services: classifies gestures
- Browser Automation → Chrome: controls browser
- Decision Engine → Local Vision Model: uses vision
- Supabase Storage → Supabase Storage: stores objects