How kommawar-tulasi/gesture-recognition-for-rubik-s-cube works
gesture-cube is a webcam-driven virtual Rubik’s cube, with a separate workflow for collecting labeled hand poses and training an SVM. At runtime, MediaPipe landmarks feed gesture recognition and hand tracking; the right hand aims, locks a tile, and drags a layer through the touchpad controller, while the left hand orbits or freezes the view. The app then updates and renders the puzzle, with keyboard controls as fallback. The README documents the end-to-end flow; sampled source confirms the feature schema, recognizer, controller, and rendering responsibilities, but not every runtime call site.
Main entry points: gesture_cube.py Hand Tracking · collect_gesture_data.py Sample Collector · gesture_svm.py Gesture Recognition · train_gesture_svm.py SVM Trainer
Components 16
Gesture Data and Training
- Sample Collector
collect_gesture_data.py - Labeled Samples
collect_gesture_data.py - SVM Trainer
train_gesture_svm.py - SVM Artifact
train_gesture_svm.py
Hand Recognition
- Landmark Detection
gesture_cube.py - Feature Extraction
gesture_svm.py - Gesture Recognition
gesture_svm.py - Hand Tracking
gesture_cube.py
Cube Interaction
- Touchpad Controller
gesture_cube.py - Cube State and Moves
gesture_cube.py - Orbit Control
gesture_cube.py
View and Controls
- Cube Renderer
gesture_cube.py - Status and Gesture UI
gesture_cube.py - Keyboard Fallback
gesture_cube.py
Other components
- User
- Webcam
Connections 19
- User → Sample Collector: labels poses
README.md - Webcam → Sample Collector: supplies video
README.md - Sample Collector → Labeled Samples: saves samples
README.md - Labeled Samples → SVM Trainer: trains from
README.md - SVM Trainer → SVM Artifact: saves pipeline
train_gesture_svm.py - User → Webcam: gestures to
README.md - Webcam → Landmark Detection: provides frames
README.md - Landmark Detection → Feature Extraction: provides landmarks
README.md - Feature Extraction → Gesture Recognition: formats features
gesture_svm.py - SVM Artifact → Gesture Recognition: loads model
gesture_svm.py - Gesture Recognition → Hand Tracking: provides gestures
README.md - Hand Tracking → Touchpad Controller: provides hand input
README.md - Touchpad Controller → Cube State and Moves: turns selected layer
README.md - Hand Tracking → Orbit Control: drives view orbit
README.md - Orbit Control → Cube Renderer: sets view orientation
README.md - Cube State and Moves → Cube Renderer: renders puzzle state
README.md - Touchpad Controller → Status and Gesture UI: shows interaction status
gesture_cube.py - User → Keyboard Fallback: uses fallback keys
README.md - Keyboard Fallback → Cube State and Moves: issues move commands
README.md