How surya2324/gesture-control works
This is a Flask-launched, webcam-based gesture-control application. A user opens the web page and starts the controller; the controller tracks hands, maps right-hand gestures to mouse/system actions, and uses the left hand as a virtual keyboard. The controller also displays the camera feed and saves screenshots. The README is empty, so the map follows the sampled source; camera, OS input, keyboard, and screenshot effects are represented as external interfaces.
Main entry points: Final.py Controller process · app.py Flask routes · index.html Control page
Components 14
Web launcher
- Flask routes
app.py - Control page
Templates/index.html
Gesture controller
- Controller process
Final.py - Hand tracker
Final.py - Gesture mapping
Final.py - Virtual keyboard
Final.py - Video overlay
Final.py
Device and OS I/O
- Webcam
- MediaPipe
- OpenCV
- Desktop controls
- Keyboard input
- Screenshot files
Other components
- User
Connections 14
- User → Flask routes: opens and controls
- Flask routes → Control page: renders
- Flask routes → Controller process: starts or stops
- Controller process → Webcam: reads frames
- Controller process → Hand tracker: processes frames
- Hand tracker → MediaPipe: detects landmarks
- Controller process → Gesture mapping: maps hand poses
- Gesture mapping → Desktop controls: issues mouse and hotkeys
- Controller process → Virtual keyboard: handles left hand
- Virtual keyboard → Keyboard input: emits keystrokes
- Controller process → OpenCV: displays frames
- Controller process → Video overlay: draws keyboard and status
- Video overlay → OpenCV: renders overlay
- Gesture mapping → Screenshot files: saves captures