# hanrekoen/prj371-project-sasl architecture

> Architecture diagram of the GitHub repository hanrekoen/prj371-project-sasl, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-15). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/hanrekoen/prj371-project-sasl
- Repository: https://github.com/hanrekoen/prj371-project-sasl

## Overview

SignMasterVR is a Unity-based South African Sign Language tutor whose lesson flow runs on a Quest while gesture recognition runs on a laptop. The learner sees a tutor demonstrate a sign, attempts it, and receives feedback before the lesson advances. The laptop server tracks webcam hand landmarks, extracts features, classifies attempts, and relays results over TCP; Unity’s lesson logic decides pass/fail. The graph also includes the documented model-training and Unity-asset generation capabilities. Unity source excerpts were not provided, so those links rely on README statements; some Python runtime relationships are supported by the source index.

Main entry points: [`SignMasterVR/GestureServer/server.py`](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/server.py) (Gesture server), [`SignMasterVR/Assets/Scripts/Lessons/LessonManager.cs`](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/Assets/Scripts/Lessons/LessonManager.cs) (Lesson manager), [`SignMasterVR/GestureServer/gesture_classifier.py`](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/gesture_classifier.py) (Model validator), [`SignMasterVR/GestureServer/sasl_features.py`](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/sasl_features.py) (Feature extraction)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_lesson["VR lesson"]
  node_lesson_manager["Lesson manager<br/>[LessonManager.cs]"]
  node_level_data["Lesson levels"]
  node_gesture_data["Gesture content"]
  node_tutor["Tutor demo<br/>[TutorController.cs]"]
  node_lesson_ui["Lesson UI<br/>[UIManager.cs]"]
end

subgraph group_recognition["Gesture recognition"]
  node_tracker["Hand tracker<br/>[hand_tracker.py]"]
  node_features["Feature extraction<br/>[sasl_features.py]"]
  node_classifier["Model validator"]
  node_sasl_classifier["SASL classifier<br/>[sasl_classifier.py]"]
  node_placeholder["Placeholder classifier<br/>[classifier.py]"]
end

subgraph group_ml["Model and content"]
  node_model["Trained model<br/>[sasl_model.py]"]
  node_training["Model training"]
  node_asset_generator["Unity asset generator"]
  node_ghost_export["Tutor hand export"]
end

subgraph group_transport["Network transport"]
  node_network_client["Network recognizer"]
  node_server["Gesture server<br/>[server.py]"]
  node_protocol["Wire protocol<br/>[protocol.py]"]
end

node_learner(("Learner"))
node_laptop(("Laptop webcam"))

node_learner -->|"attempts signs"| node_lesson_manager
node_lesson_manager -->|"uses levels"| node_level_data
node_lesson_manager -->|"checks target"| node_gesture_data
node_lesson_manager -->|"requests demo"| node_tutor
node_lesson_manager -->|"updates feedback"| node_lesson_ui
node_lesson_manager -->|"sets target"| node_network_client
node_network_client -->|"sends target"| node_server
node_server -->|"sends result"| node_network_client
node_server -->|"encodes messages"| node_protocol
node_laptop -.->|"provides frames"| node_server
node_server -->|"tracks hands"| node_tracker
node_server -->|"classifies attempts"| node_sasl_classifier
node_server -->|"selects fallback"| node_placeholder
node_tracker -->|"provides landmarks"| node_classifier
node_classifier -->|"extracts features"| node_features
node_classifier -.->|"loads model"| node_model
node_sasl_classifier -->|"wraps validator"| node_classifier
node_training -->|"uses features"| node_features
node_training -->|"trains artifact"| node_model
node_asset_generator -->|"uses features"| node_features
node_asset_generator -.->|"generates assets"| node_gesture_data
node_ghost_export -->|"uses features"| node_features
node_ghost_export -.->|"exports animations"| node_tutor

click node_lesson_manager "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/Assets/Scripts/Lessons/LessonManager.cs"
click node_level_data "https://github.com/hanrekoen/prj371-project-sasl/tree/main/SignMasterVR/Assets/Data/Levels"
click node_gesture_data "https://github.com/hanrekoen/prj371-project-sasl/tree/main/SignMasterVR/Assets/Data/Gestures"
click node_tutor "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/Assets/Scripts/Tutor/TutorController.cs"
click node_lesson_ui "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/Assets/Scripts/UI/UIManager.cs"
click node_network_client "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/Assets/Scripts/ML/NetworkGestureRecognizer.cs"
click node_server "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/server.py"
click node_protocol "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/protocol.py"
click node_tracker "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/hand_tracker.py"
click node_features "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/sasl_features.py"
click node_classifier "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/gesture_classifier.py"
click node_sasl_classifier "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/sasl_classifier.py"
click node_placeholder "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/classifier.py"
click node_model "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/sasl_model.py"
click node_training "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/train_gesture_model.py"
click node_asset_generator "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/make_unity_assets.py"
click node_ghost_export "https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/export_ghost_hand.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_lesson_manager,node_level_data,node_gesture_data,node_tutor,node_lesson_ui toneBlue
class node_tracker,node_features,node_classifier,node_sasl_classifier,node_placeholder toneAmber
class node_model,node_training,node_asset_generator,node_ghost_export toneMint
class node_network_client,node_server,node_protocol toneRose
class node_learner,node_laptop toneIndigo
```

## Components

### VR lesson

- [Lesson manager](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/Assets/Scripts/Lessons/LessonManager.cs): `SignMasterVR/Assets/Scripts/Lessons/LessonManager.cs`
- [Lesson levels](https://github.com/hanrekoen/prj371-project-sasl/tree/main/SignMasterVR/Assets/Data/Levels): `SignMasterVR/Assets/Data/Levels`
- [Gesture content](https://github.com/hanrekoen/prj371-project-sasl/tree/main/SignMasterVR/Assets/Data/Gestures): `SignMasterVR/Assets/Data/Gestures`
- [Tutor demo](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/Assets/Scripts/Tutor/TutorController.cs): `SignMasterVR/Assets/Scripts/Tutor/TutorController.cs`
- [Lesson UI](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/Assets/Scripts/UI/UIManager.cs): `SignMasterVR/Assets/Scripts/UI/UIManager.cs`

### Gesture recognition

- [Hand tracker](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/hand_tracker.py): `SignMasterVR/GestureServer/hand_tracker.py`
- [Feature extraction](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/sasl_features.py): `SignMasterVR/GestureServer/sasl_features.py`
- [Model validator](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/gesture_classifier.py): `SignMasterVR/GestureServer/gesture_classifier.py`
- [SASL classifier](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/sasl_classifier.py): `SignMasterVR/GestureServer/sasl_classifier.py`
- [Placeholder classifier](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/classifier.py): `SignMasterVR/GestureServer/classifier.py`

### Model and content

- [Trained model](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/sasl_model.py): `SignMasterVR/GestureServer/sasl_model.py`
- [Model training](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/train_gesture_model.py): `SignMasterVR/GestureServer/train_gesture_model.py`
- [Unity asset generator](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/make_unity_assets.py): `SignMasterVR/GestureServer/make_unity_assets.py`
- [Tutor hand export](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/export_ghost_hand.py): `SignMasterVR/GestureServer/export_ghost_hand.py`

### Network transport

- [Network recognizer](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/Assets/Scripts/ML/NetworkGestureRecognizer.cs): `SignMasterVR/Assets/Scripts/ML/NetworkGestureRecognizer.cs`
- [Gesture server](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/server.py): `SignMasterVR/GestureServer/server.py`
- [Wire protocol](https://github.com/hanrekoen/prj371-project-sasl/blob/main/SignMasterVR/GestureServer/protocol.py): `SignMasterVR/GestureServer/protocol.py`

### Other components

- **Learner**
- **Laptop webcam**

## Connections

- Learner → Lesson manager: attempts signs (evidence: `README.md`)
- Lesson manager → Lesson levels: uses levels (evidence: `README.md`)
- Lesson manager → Gesture content: checks target (evidence: `README.md`)
- Lesson manager → Tutor demo: requests demo (evidence: `README.md`)
- Lesson manager → Lesson UI: updates feedback (evidence: `README.md`)
- Lesson manager → Network recognizer: sets target (evidence: `README.md`)
- Network recognizer → Gesture server: sends target
- Gesture server → Network recognizer: sends result
- Gesture server → Wire protocol: encodes messages (evidence: `SignMasterVR/GestureServer/server.py`)
- Laptop webcam → Gesture server: provides frames (evidence: `README.md`)
- Gesture server → Hand tracker: tracks hands (evidence: `SignMasterVR/GestureServer/server.py`)
- Gesture server → SASL classifier: classifies attempts (evidence: `SignMasterVR/GestureServer/server.py`)
- Gesture server → Placeholder classifier: selects fallback (evidence: `SignMasterVR/GestureServer/server.py`)
- Hand tracker → Model validator: provides landmarks (evidence: `SignMasterVR/GestureServer/gesture_classifier.py`)
- Model validator → Feature extraction: extracts features (evidence: `SignMasterVR/GestureServer/gesture_classifier.py`)
- Model validator → Trained model: loads model
- SASL classifier → Model validator: wraps validator (evidence: `SignMasterVR/GestureServer/sasl_classifier.py`)
- Model training → Feature extraction: uses features (evidence: `SignMasterVR/GestureServer/train_gesture_model.py`)
- Model training → Trained model: trains artifact (evidence: `SignMasterVR/GestureServer/train_gesture_model.py`)
- Unity asset generator → Feature extraction: uses features (evidence: `SignMasterVR/GestureServer/make_unity_assets.py`)
- Unity asset generator → Gesture content: generates assets (evidence: `README.md`)
- Tutor hand export → Feature extraction: uses features (evidence: `SignMasterVR/GestureServer/export_ghost_hand.py`)
- Tutor hand export → Tutor demo: exports animations (evidence: `README.md`)
