# swathi-r29/gestureiq architecture

> Architecture diagram of the GitHub repository swathi-r29/gestureiq, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/swathi-r29/gestureiq
- Repository: https://github.com/swathi-r29/gestureiq

## Overview

GestureIQ is a Bharatanatyam learning and monitoring platform. Students can authenticate, study single- and double-hand mudra lessons, and practice with browser-based pose/mudra feedback; staff and admins manage learners, content, and live classes. The backend provides account, content, and class APIs, while a separate Flask detection service processes camera frames. The graph shows the documented three-service product and source-indexed calls; the frontend-to-detection-service connection is shown as unverified because the excerpts do not establish its transport.

Main entry points: [`gestureiq-web/src/App.jsx`](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/App.jsx) (GestureIQ web app), [`gestureiq-web/src/utils/holisticScoreEngine.js`](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/holisticScoreEngine.js) (Holistic scoring), [`backend/server.js`](https://github.com/swathi-r29/gestureiq/blob/main/backend/server.js) (Express API), [`gestureiq-web/src/pages/Detect.jsx`](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/Detect.jsx) (Camera practice)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_web["Student experience"]
  node_browser["GestureIQ web app<br/>[App.jsx]"]
  node_authui["Authentication state<br/>[AuthContext.jsx]"]
  node_lessons["Mudra lessons<br/>[Learn.jsx]"]
  node_doublelessons["Double mudra lessons<br/>[LearnDouble.jsx]"]
  node_practice["Camera practice<br/>[Detect.jsx]"]
  node_voice["Voice guidance<br/>[useVoiceGuide.jsx]"]
end

subgraph group_vision["Gesture analysis"]
  node_score["Holistic scoring"]
  node_bodyrules["Body pose rules<br/>[bodyPoseRules.js]"]
  node_georules["Hand geometry rules<br/>[geometricRules.js]"]
  node_face["Face alignment rules"]
  node_normalize["Pose normalization"]
  node_detection["Flask detection service<br/>[flask_app.py]"]
  node_features["Single-hand features"]
  node_doublefeatures["Double-hand features"]
end

subgraph group_api["Platform API"]
  node_backend["Express API<br/>[server.js]"]
  node_authroutes["Authentication routes<br/>[auth.js]"]
  node_users[("User accounts<br/>[User.js]")]
  node_authmw["Token authorization<br/>[auth.js]"]
  node_mudraroutes["Mudra content routes<br/>[mudraRoutes.js]"]
  node_mudracontent[("Mudra content<br/>[MudraContent.js]")]
end

subgraph group_classes["Live instruction"]
  node_staffroutes["Staff operations<br/>[staffRoutes.js]"]
  node_studentroutes["Student operations<br/>[studentRoutes.js]"]
  node_liveclass[("Live classes<br/>[LiveClass.js]")]
  node_sessions[("Class session history<br/>[ClassSession.js]")]
  node_liveweb["Student live class"]
  node_conduct["Staff conducts class"]
end

node_student(("Student"))
node_staff(("Staff"))

node_student -->|"uses"| node_browser
node_staff -->|"uses"| node_browser
node_browser -->|"provides auth"| node_authui
node_browser -->|"routes to"| node_lessons
node_browser -->|"routes to"| node_doublelessons
node_browser -->|"routes to"| node_practice
node_browser -->|"routes to"| node_liveweb
node_browser -->|"routes to"| node_conduct
node_practice -->|"evaluates"| node_score
node_practice -->|"uses guide"| node_voice
node_score -->|"evaluates pose"| node_bodyrules
node_score -->|"classifies hands"| node_georules
node_score -->|"evaluates face"| node_face
node_score -->|"normalizes pose"| node_normalize
node_practice -.->|"sends frames"| node_detection
node_detection -->|"extracts features"| node_features
node_detection -->|"extracts features"| node_doublefeatures
node_backend -->|"mounts routes"| node_authroutes
node_backend -->|"mounts routes"| node_mudraroutes
node_backend -->|"mounts routes"| node_staffroutes
node_backend -->|"mounts routes"| node_studentroutes
node_authroutes -->|"reads accounts"| node_users
node_authmw -->|"checks status"| node_users
node_mudraroutes -->|"authorizes"| node_authmw
node_mudraroutes -->|"queries content"| node_mudracontent
node_staffroutes -->|"manages classes"| node_liveclass
node_staffroutes -->|"reads reports"| node_sessions
node_staffroutes -->|"loads students"| node_users
node_studentroutes -->|"joins classes"| node_liveclass
node_studentroutes -->|"reads history"| node_sessions
node_studentroutes -->|"loads student"| node_users

click node_browser "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/App.jsx"
click node_authui "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/context/AuthContext.jsx"
click node_lessons "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/Learn.jsx"
click node_doublelessons "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/LearnDouble.jsx"
click node_practice "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/Detect.jsx"
click node_voice "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/hooks/useVoiceGuide.jsx"
click node_score "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/holisticScoreEngine.js"
click node_bodyrules "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/bodyPoseRules.js"
click node_georules "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/geometricRules.js"
click node_face "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/faceAlignmentRules.js"
click node_normalize "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/poseNormalization.js"
click node_detection "https://github.com/swathi-r29/gestureiq/blob/main/notebooks/flask_app.py"
click node_features "https://github.com/swathi-r29/gestureiq/blob/main/utils/feature_engineering.py"
click node_doublefeatures "https://github.com/swathi-r29/gestureiq/blob/main/utils/double_feature_engineering.py"
click node_backend "https://github.com/swathi-r29/gestureiq/blob/main/backend/server.js"
click node_authroutes "https://github.com/swathi-r29/gestureiq/blob/main/backend/routes/auth.js"
click node_users "https://github.com/swathi-r29/gestureiq/blob/main/backend/models/User.js"
click node_authmw "https://github.com/swathi-r29/gestureiq/blob/main/backend/middleware/auth.js"
click node_mudraroutes "https://github.com/swathi-r29/gestureiq/blob/main/backend/routes/mudraRoutes.js"
click node_mudracontent "https://github.com/swathi-r29/gestureiq/blob/main/backend/models/MudraContent.js"
click node_staffroutes "https://github.com/swathi-r29/gestureiq/blob/main/backend/routes/staffRoutes.js"
click node_studentroutes "https://github.com/swathi-r29/gestureiq/blob/main/backend/routes/studentRoutes.js"
click node_liveclass "https://github.com/swathi-r29/gestureiq/blob/main/backend/models/LiveClass.js"
click node_sessions "https://github.com/swathi-r29/gestureiq/blob/main/backend/models/ClassSession.js"
click node_liveweb "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/StudentLiveClass.jsx"
click node_conduct "https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/staff/StaffConductClass.jsx"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_browser,node_authui,node_lessons,node_doublelessons,node_practice,node_voice toneBlue
class node_score,node_bodyrules,node_georules,node_face,node_normalize,node_detection,node_features,node_doublefeatures toneAmber
class node_backend,node_authroutes,node_users,node_authmw,node_mudraroutes,node_mudracontent toneMint
class node_staffroutes,node_studentroutes,node_liveclass,node_sessions,node_liveweb,node_conduct toneRose
class node_student,node_staff toneIndigo
```

## Components

### Student experience

- [GestureIQ web app](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/App.jsx): `gestureiq-web/src/App.jsx`
- [Authentication state](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/context/AuthContext.jsx): `gestureiq-web/src/context/AuthContext.jsx`
- [Mudra lessons](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/Learn.jsx): `gestureiq-web/src/pages/Learn.jsx`
- [Double mudra lessons](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/LearnDouble.jsx): `gestureiq-web/src/pages/LearnDouble.jsx`
- [Camera practice](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/Detect.jsx): `gestureiq-web/src/pages/Detect.jsx`
- [Voice guidance](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/hooks/useVoiceGuide.jsx): `gestureiq-web/src/hooks/useVoiceGuide.jsx`

### Gesture analysis

- [Holistic scoring](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/holisticScoreEngine.js): `gestureiq-web/src/utils/holisticScoreEngine.js`
- [Body pose rules](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/bodyPoseRules.js): `gestureiq-web/src/utils/bodyPoseRules.js`
- [Hand geometry rules](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/geometricRules.js): `gestureiq-web/src/utils/geometricRules.js`
- [Face alignment rules](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/faceAlignmentRules.js): `gestureiq-web/src/utils/faceAlignmentRules.js`
- [Pose normalization](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/utils/poseNormalization.js): `gestureiq-web/src/utils/poseNormalization.js`
- [Flask detection service](https://github.com/swathi-r29/gestureiq/blob/main/notebooks/flask_app.py): `notebooks/flask_app.py`
- [Single-hand features](https://github.com/swathi-r29/gestureiq/blob/main/utils/feature_engineering.py): `utils/feature_engineering.py`
- [Double-hand features](https://github.com/swathi-r29/gestureiq/blob/main/utils/double_feature_engineering.py): `utils/double_feature_engineering.py`

### Platform API

- [Express API](https://github.com/swathi-r29/gestureiq/blob/main/backend/server.js): `backend/server.js`
- [Authentication routes](https://github.com/swathi-r29/gestureiq/blob/main/backend/routes/auth.js): `backend/routes/auth.js`
- [User accounts](https://github.com/swathi-r29/gestureiq/blob/main/backend/models/User.js): `backend/models/User.js`
- [Token authorization](https://github.com/swathi-r29/gestureiq/blob/main/backend/middleware/auth.js): `backend/middleware/auth.js`
- [Mudra content routes](https://github.com/swathi-r29/gestureiq/blob/main/backend/routes/mudraRoutes.js): `backend/routes/mudraRoutes.js`
- [Mudra content](https://github.com/swathi-r29/gestureiq/blob/main/backend/models/MudraContent.js): `backend/models/MudraContent.js`

### Live instruction

- [Staff operations](https://github.com/swathi-r29/gestureiq/blob/main/backend/routes/staffRoutes.js): `backend/routes/staffRoutes.js`
- [Student operations](https://github.com/swathi-r29/gestureiq/blob/main/backend/routes/studentRoutes.js): `backend/routes/studentRoutes.js`
- [Live classes](https://github.com/swathi-r29/gestureiq/blob/main/backend/models/LiveClass.js): `backend/models/LiveClass.js`
- [Class session history](https://github.com/swathi-r29/gestureiq/blob/main/backend/models/ClassSession.js): `backend/models/ClassSession.js`
- [Student live class](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/StudentLiveClass.jsx): `gestureiq-web/src/pages/StudentLiveClass.jsx`
- [Staff conducts class](https://github.com/swathi-r29/gestureiq/blob/main/gestureiq-web/src/pages/staff/StaffConductClass.jsx): `gestureiq-web/src/pages/staff/StaffConductClass.jsx`

### Other components

- **Student**
- **Staff**

## Connections

- Student → GestureIQ web app: uses (evidence: `README.md`)
- Staff → GestureIQ web app: uses (evidence: `README.md`)
- GestureIQ web app → Authentication state: provides auth (evidence: `gestureiq-web/src/App.jsx`)
- GestureIQ web app → Mudra lessons: routes to (evidence: `gestureiq-web/src/App.jsx`)
- GestureIQ web app → Double mudra lessons: routes to (evidence: `gestureiq-web/src/App.jsx`)
- GestureIQ web app → Camera practice: routes to (evidence: `gestureiq-web/src/App.jsx`)
- GestureIQ web app → Student live class: routes to (evidence: `gestureiq-web/src/App.jsx`)
- GestureIQ web app → Staff conducts class: routes to (evidence: `gestureiq-web/src/App.jsx`)
- Camera practice → Holistic scoring: evaluates (evidence: `gestureiq-web/src/pages/Detect.jsx`)
- Camera practice → Voice guidance: uses guide (evidence: `gestureiq-web/src/pages/Detect.jsx`)
- Holistic scoring → Body pose rules: evaluates pose (evidence: `gestureiq-web/src/utils/holisticScoreEngine.js`)
- Holistic scoring → Hand geometry rules: classifies hands (evidence: `gestureiq-web/src/utils/holisticScoreEngine.js`)
- Holistic scoring → Face alignment rules: evaluates face (evidence: `gestureiq-web/src/utils/holisticScoreEngine.js`)
- Holistic scoring → Pose normalization: normalizes pose (evidence: `gestureiq-web/src/utils/holisticScoreEngine.js`)
- Camera practice → Flask detection service: sends frames
- Flask detection service → Single-hand features: extracts features (evidence: `notebooks/flask_app.py`)
- Flask detection service → Double-hand features: extracts features (evidence: `notebooks/flask_app.py`)
- Express API → Authentication routes: mounts routes (evidence: `backend/server.js`)
- Express API → Mudra content routes: mounts routes (evidence: `backend/server.js`)
- Express API → Staff operations: mounts routes (evidence: `backend/server.js`)
- Express API → Student operations: mounts routes (evidence: `backend/server.js`)
- Authentication routes → User accounts: reads accounts (evidence: `backend/routes/auth.js`)
- Token authorization → User accounts: checks status (evidence: `backend/middleware/auth.js`)
- Mudra content routes → Token authorization: authorizes (evidence: `backend/routes/mudraRoutes.js`)
- Mudra content routes → Mudra content: queries content (evidence: `backend/routes/mudraRoutes.js`)
- Staff operations → Live classes: manages classes (evidence: `backend/routes/staffRoutes.js`)
- Staff operations → Class session history: reads reports (evidence: `backend/routes/staffRoutes.js`)
- Staff operations → User accounts: loads students (evidence: `backend/routes/staffRoutes.js`)
- Student operations → Live classes: joins classes (evidence: `backend/routes/studentRoutes.js`)
- Student operations → Class session history: reads history (evidence: `backend/routes/studentRoutes.js`)
- Student operations → User accounts: loads student (evidence: `backend/routes/studentRoutes.js`)
