How swathi-r29/gestureiq works
GestureIQ is a Bharatanatyam learning and monitoring platform. Students can authenticate, study single- and double-hand mudra lessons, and practice with browser-based pose/mudra feedback; staff and admins manage learners, content, and live classes. The backend provides account, content, and class APIs, while a separate Flask detection service processes camera frames. The graph shows the documented three-service product and source-indexed calls; the frontend-to-detection-service connection is shown as unverified because the excerpts do not establish its transport.
Main entry points: App.jsx GestureIQ web app · holisticScoreEngine.js Holistic scoring · server.js Express API · Detect.jsx Camera practice
Components 28
Student experience
- GestureIQ web app
gestureiq-web/src/App.jsx - Authentication state
gestureiq-web/src/context/AuthContext.jsx - Mudra lessons
gestureiq-web/src/pages/Learn.jsx - Double mudra lessons
gestureiq-web/src/pages/LearnDouble.jsx - Camera practice
gestureiq-web/src/pages/Detect.jsx - Voice guidance
gestureiq-web/src/hooks/useVoiceGuide.jsx
Gesture analysis
- Holistic scoring
gestureiq-web/src/utils/holisticScoreEngine.js - Body pose rules
gestureiq-web/src/utils/bodyPoseRules.js - Hand geometry rules
gestureiq-web/src/utils/geometricRules.js - Face alignment rules
gestureiq-web/src/utils/faceAlignmentRules.js - Pose normalization
gestureiq-web/src/utils/poseNormalization.js - Flask detection service
notebooks/flask_app.py - Single-hand features
utils/feature_engineering.py - Double-hand features
utils/double_feature_engineering.py
Platform API
- Express API
backend/server.js - Authentication routes
backend/routes/auth.js - User accounts
backend/models/User.js - Token authorization
backend/middleware/auth.js - Mudra content routes
backend/routes/mudraRoutes.js - Mudra content
backend/models/MudraContent.js
Live instruction
- Staff operations
backend/routes/staffRoutes.js - Student operations
backend/routes/studentRoutes.js - Live classes
backend/models/LiveClass.js - Class session history
backend/models/ClassSession.js - Student live class
gestureiq-web/src/pages/StudentLiveClass.jsx - Staff conducts class
gestureiq-web/src/pages/staff/StaffConductClass.jsx
Other components
- Student
- Staff
Connections 31
- Student → GestureIQ web app: uses
README.md - Staff → GestureIQ web app: uses
README.md - GestureIQ web app → Authentication state: provides auth
gestureiq-web/src/App.jsx - GestureIQ web app → Mudra lessons: routes to
gestureiq-web/src/App.jsx - GestureIQ web app → Double mudra lessons: routes to
gestureiq-web/src/App.jsx - GestureIQ web app → Camera practice: routes to
gestureiq-web/src/App.jsx - GestureIQ web app → Student live class: routes to
gestureiq-web/src/App.jsx - GestureIQ web app → Staff conducts class: routes to
gestureiq-web/src/App.jsx - Camera practice → Holistic scoring: evaluates
gestureiq-web/src/pages/Detect.jsx - Camera practice → Voice guidance: uses guide
gestureiq-web/src/pages/Detect.jsx - Holistic scoring → Body pose rules: evaluates pose
gestureiq-web/src/utils/holisticScoreEngine.js - Holistic scoring → Hand geometry rules: classifies hands
gestureiq-web/src/utils/holisticScoreEngine.js - Holistic scoring → Face alignment rules: evaluates face
gestureiq-web/src/utils/holisticScoreEngine.js - Holistic scoring → Pose normalization: normalizes pose
gestureiq-web/src/utils/holisticScoreEngine.js - Camera practice → Flask detection service: sends frames
- Flask detection service → Single-hand features: extracts features
notebooks/flask_app.py - Flask detection service → Double-hand features: extracts features
notebooks/flask_app.py - Express API → Authentication routes: mounts routes
backend/server.js - Express API → Mudra content routes: mounts routes
backend/server.js - Express API → Staff operations: mounts routes
backend/server.js - Express API → Student operations: mounts routes
backend/server.js - Authentication routes → User accounts: reads accounts
backend/routes/auth.js - Token authorization → User accounts: checks status
backend/middleware/auth.js - Mudra content routes → Token authorization: authorizes
backend/routes/mudraRoutes.js - Mudra content routes → Mudra content: queries content
backend/routes/mudraRoutes.js - Staff operations → Live classes: manages classes
backend/routes/staffRoutes.js - Staff operations → Class session history: reads reports
backend/routes/staffRoutes.js - Staff operations → User accounts: loads students
backend/routes/staffRoutes.js - Student operations → Live classes: joins classes
backend/routes/studentRoutes.js - Student operations → Class session history: reads history
backend/routes/studentRoutes.js - Student operations → User accounts: loads student
backend/routes/studentRoutes.js