How ninjacat10/eye-head-mouse works
Eye + Head Mouse is a Windows webcam-based hands-free mouse. A worker processes camera frames into facial features and either gesture or head-nod click signals; a confidence gate and Brain coordinate pointing, clicks, and interaction modes before issuing mouse actions. The Qt panel, calibration window, and overlay expose controls and feedback. README documents additional menu actions and optional eye-gaze calibration. Some internal wiring is unsampled, so edges for documented but unseen relationships cite the README; the graph omits uncertain implementation details.
Main entry points: main.py Frame worker · state_manager.py Tracking Brain · control_panel.py Control panel · eye_tracker.py Face features
Components 21
Vision and input
- Frame worker
src/main.py - Camera capture
src/eyemouse/camera.py - Face features
src/eyemouse/eye_tracker.py - Head classifier
src/eyemouse/head_classifier.py - Gesture detection
src/eyemouse/gestures.py
Tracking control
- Confidence gate
src/eyemouse/confidence_gate.py - Tracking Brain
src/eyemouse/state_manager.py - Head mapping
src/eyemouse/head_pointer.py - Gaze calibration
src/eyemouse/gaze_mapper.py - Signal smoothing
src/eyemouse/smoothing.py - Click state machine
src/eyemouse/click_controller.py - Calibration data
src/eyemouse/paths.py
Mouse interaction
- Scroll and drag
src/eyemouse/scroll_drag.py - System cursor
src/eyemouse/cursor_controller.py
UI and calibration
- Control panel
src/eyemouse/control_panel.py - Navigator overlay
src/eyemouse/overlay.py - Calibration UI
src/eyemouse/calibration_ui.py - Settings
src/eyemouse/config.py
Other components
- User
- Webcam
- Windows desktop
Connections 29
- User → Webcam: faces
README.md - Webcam → Camera capture: captures frames
README.md - Frame worker → Camera capture: reads frames
src/main.py - Frame worker → Face features: processes frames
src/main.py - Frame worker → Head classifier: runs nod model
src/main.py - Frame worker → Confidence gate: checks probabilities
src/main.py - Frame worker → Gesture detection: detects gestures
src/main.py - Frame worker → Tracking Brain: updates tracking
src/main.py - Face features → Head mapping: supplies pose
README.md - Face features → Gaze calibration: supplies features
README.md - Gesture detection → Confidence gate: provides click signal
README.md - Confidence gate → Tracking Brain: provides confidence
src/main.py - Tracking Brain → Head mapping: maps head pointing
src/eyemouse/state_manager.py - Tracking Brain → Gaze calibration: maps eye gaze
src/eyemouse/state_manager.py - Tracking Brain → Signal smoothing: smooths pointing
src/eyemouse/state_manager.py - Tracking Brain → Click state machine: advances click state
src/eyemouse/state_manager.py - Tracking Brain → Scroll and drag: controls modes
src/eyemouse/state_manager.py - Tracking Brain → System cursor: issues mouse actions
src/eyemouse/state_manager.py - System cursor → Windows desktop: moves and clicks
src/eyemouse/cursor_controller.py - User → Control panel: sets controls
README.md - Control panel → Frame worker: sends commands
src/main.py - Frame worker → Control panel: reports status
src/main.py - Frame worker → Navigator overlay: publishes status
src/main.py - User → Calibration UI: provides calibration targets
README.md - Calibration UI → Frame worker: returns mapper
src/main.py - Head mapping → Calibration data: loads and saves calibration
src/eyemouse/head_pointer.py - Gaze calibration → Calibration data: loads and saves calibration
src/eyemouse/gaze_mapper.py - Control panel → Settings: tunes and saves settings
src/eyemouse/control_panel.py - Tracking Brain → Navigator overlay: supplies display state
README.md