How aravindraj0007/mudra-identification works
Mudra Academy is a Bharatanatyam learning app with reference material, practice games, live hand detection, and an AI chat guide. Users can explore mudras or practice them through detection; Electron also runs a separate Python/YOLO inference service. The excerpts show the Electron IPC-to-Python path and the JavaScript detector’s use of its single-hand inference module. The README is empty, and page markup was not sampled, so links from individual pages to features are not asserted.
Main entry points: main.js Electron IPC host · chat-widget.js Natya Guru chat · mudra_inference.py YOLO inference · index.html Home experience
Components 19
Learning experience
- Home experience
index.html - Mudra library
pages/library.html - Detection modes
pages/detection-mode.html - Live detection
pages/live-detection.html - Two-hand detection
pages/double-hand-detection.html - Ghost mode
pages/ghost-mode.html - Flashcards
pages/games/flashcard.html - Quiz game
pages/games/quiz.html - Sequence game
pages/games/sequence.html - Natya Guru chat
js/chat-widget.js
Mudra detection
- Rule-based detector
js/mudra-detection.js - Single-hand inference
js/mudra-inference.js - Name normalization
js/mudra-constants.js
Desktop inference
- Electron IPC host
electron/main.js - Renderer bridge
electron/preload.js - YOLO inference
ml/mudra_inference.py - YOLO model
ml/models/final.pt
Other components
- Learner
- Gemini API
Connections 17
- Learner → Home experience: opens
- Learner → Mudra library: browses
- Learner → Detection modes: selects
- Learner → Live detection: practices
- Learner → Two-hand detection: practices
- Learner → Ghost mode: practices
- Learner → Flashcards: practices
- Learner → Quiz game: plays
- Learner → Sequence game: practices
- Learner → Natya Guru chat: asks
- Natya Guru chat → Gemini API: requests responses
js/chat-widget.js - Rule-based detector → Single-hand inference: runs ML prediction
js/mudra-detection.js - Learner → Electron IPC host: launches app
- Electron IPC host → Home experience: loads window
electron/main.js - Renderer bridge → Electron IPC host: invokes detection IPC
electron/preload.js - Electron IPC host → YOLO inference: spawns process
electron/main.js - YOLO inference → YOLO model: loads model
ml/mudra_inference.py