How srisaravanan55/-gesture-calc-ai works
GestureCalc is a Flask web app for operating a calculator through webcam hand gestures, with browser-based modes and optional Gemini assistance. The documented workflow is browser interaction with the app, webcam frame processing, hand-landmark and gesture recognition, then gesture-driven calculator input and displayed feedback. The excerpt shows camera capture, classification, shared state, skeleton rendering, and AI queries; it does not show the calculator or browser routes, so those capabilities and links are documented rather than inferred from unsampled code.
Main entry points: index.html Browser UI · app.py Webcam capture · hand_landmarker.task Landmarker model
Components 17
Web interface
- Browser UI
templates/index.html - Flask app
app.py
Gesture recognition
- Webcam capture
app.py - Hand landmarks
app.py - Finger states
app.py - Gesture classifier
app.py - Hold debounce
app.py - Skeleton overlay
app.py - Gesture state
app.py - Landmarker model
hand_landmarker.task
Calculator modes
- Standard calculator
app.py - Scientific mode
app.py - Air Draw
app.py - Voice input
app.py
AI assistance
- Gemini AI
app.py
Other components
- User
- Camera
Connections 18
- User → Browser UI: uses
README.md - Browser UI → Flask app: requests
README.md - Webcam capture → Camera: captures frames
app.py - Webcam capture → Hand landmarks: processes frames
app.py - Hand landmarks → Landmarker model: loads
- Hand landmarks → Finger states: provides landmarks
app.py - Finger states → Gesture classifier: classifies states
app.py - Gesture classifier → Hold debounce: debounces gesture
app.py - Webcam capture → Skeleton overlay: draws skeleton
app.py - Hold debounce → Gesture state: updates
app.py - Gesture state → Browser UI: provides gesture feedback
- Browser UI → Standard calculator: selects inputs
README.md - Browser UI → Scientific mode: selects mode
README.md - Browser UI → Air Draw: starts tracing
README.md - Browser UI → Voice input: submits speech
README.md - Voice input → Gemini AI: parses calculations
README.md - Browser UI → Gemini AI: requests assistance
app.py - Gemini AI → Browser UI: returns response
app.py