How raj14428o/sai works
Vision Mate combines voice assistance, walking guidance, face identification, and everyday tools. The main menu starts the voice assistant, standalone navigation, and face-recognition view; in voice mode, microphone input is routed by the controller to the selected capability, with spoken responses. Walking mode combines object detection, depth estimates, and navigation decisions. The README documents weather, email, reminders, notes, calculation, and device status. Some subsystem details are documented but their full implementations were not sampled, so those links rely on README evidence.
Main entry points: controller.py Command controller · detection_code_video.py Navigation video · main.py Mode menu · daily_tools.py Daily tools
Components 22
Application entry
- Mode menu
main.py - Voice entry
Communication/main.py
Voice assistant
- Command controller
Communication/assistant/controller.py - Speech input
Communication/voice/speech_input.py - Speech output
Communication/voice/speech_output.py - Email drafting
Communication/modules/communication_tool.py - Contact book
Communication/contacts.json
Walking navigation
- Navigation video
obstacle_detection/detection_code_video.py - Depth estimation
obstacle_detection/depth_estimator.py - Hazard guidance
obstacle_detection/navigation_engine.py
Face identification
- Face manager
opencv/Faces/face_manager.py - Live face view
opencv/Faces/face_recognition.py - Face training
opencv/Faces/face_manager.py - Training photos
opencv/Resources/Faces/train
Productivity tools
- Daily tools
Communication/modules/daily_tools.py - Reminders
Communication/reminders.json - Notes
Communication/notes.json
Other components
- User
- Gmail SMTP
- Gemini service
- Camera
- Weather service
Connections 25
- User → Mode menu: selects mode
main.py - Mode menu → Voice entry: starts voice
main.py - Mode menu → Navigation video: starts navigation
main.py - Mode menu → Live face view: starts face view
main.py - Mode menu → Face training: starts retraining
main.py - Voice entry → Command controller: runs commands
Communication/main.py - User → Speech input: speaks commands
README.md - Command controller → Speech input: listens through
Communication/assistant/controller.py - Command controller → Speech output: speaks responses
Communication/assistant/controller.py - Command controller → Email drafting: manages email
Communication/assistant/controller.py - Email drafting → Contact book: looks up
Communication/modules/communication_tool.py - Email drafting → Gmail SMTP: sends through
Communication/modules/communication_tool.py - Command controller → Gemini service: asks questions
README.md - Command controller → Daily tools: routes tool requests
Communication/assistant/controller.py - Daily tools → Reminders: reads and writes
Communication/modules/daily_tools.py - Daily tools → Notes: reads and writes
Communication/modules/daily_tools.py - Daily tools → Weather service: fetches weather
README.md - Command controller → Navigation video: starts walking mode
Communication/assistant/controller.py - Navigation video → Camera: captures frames
obstacle_detection/detection_code_video.py - Navigation video → Depth estimation: estimates depth
obstacle_detection/detection_code_video.py - Navigation video → Hazard guidance: updates guidance
obstacle_detection/detection_code_video.py - Navigation video → Speech output: speaks guidance
obstacle_detection/detection_code_video.py - Command controller → Face manager: identifies faces
Communication/assistant/controller.py - Live face view → Camera: captures faces
README.md - Face training → Training photos: trains from photos
opencv/Faces/face_manager.py