# saranya-aluru/signova-dbms-project architecture

> Architecture diagram of the GitHub repository saranya-aluru/signova-dbms-project, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-17). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/saranya-aluru/signova-dbms-project
- Repository: https://github.com/saranya-aluru/signova-dbms-project

## Overview

Signova is a prototype for real-time recognition of selected Indian Sign Language gestures. A user enables the webcam in the React interface; camera frames go to Flask, where MediaPipe landmarks are normalized and classified, and the result is presented in the interface. The documented backend also looks up sign details and records recognition history in MySQL; Kafka event publishing is an optional service capability. Data collection, extraction, and model-training modules support vocabulary development. Some backend stages and integrations are documented but their wiring was not fully sampled.

Main entry points: [`project/isl_dataset`](https://github.com/saranya-aluru/signova-dbms-project/tree/main/project/isl_dataset) (Gesture samples), [`project/app.py`](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/app.py) (Flask API), [`project/signova/src/CameraStage.jsx`](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/CameraStage.jsx) (Camera capture), [`project/signova/src/App.jsx`](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/App.jsx) (Recognition UI)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_frontend["Recognition Interface"]
  node_camera["Camera capture<br/>[CameraStage.jsx]"]
  node_app["Recognition UI<br/>[App.jsx]"]
  node_entry["React entry<br/>[main.jsx]"]
  node_signs["Sign library<br/>[Signs.jsx]"]
end

subgraph group_backend["Recognition Backend"]
  node_api["Flask API<br/>[app.py]"]
  node_hand_detection["Hand detection<br/>[app.py]"]
  node_landmarks["Landmark processing<br/>[app.py]"]
  node_classification["Sign classification<br/>[app.py]"]
  node_hand_tracking["Hand tracking<br/>[hand_tracking.py]"]
  node_recognizer["Standalone recognizer<br/>[recognize.py]"]
end

subgraph group_data["Data and Models"]
  node_data_collection["Sample collection<br/>[collect_data.py]"]
  node_two_hand_collection["Two-hand collection"]
  node_dataset_extraction["Dataset extraction<br/>[extract_dataset.py]"]
  node_selected_extraction["Selected extraction"]
  node_training["Model training<br/>[train_model.py]"]
  node_training_all["Expanded training<br/>[train_model_all.py]"]
  node_two_hand_training["Two-hand training<br/>[train_two_hand.py]"]
  node_samples["Gesture samples"]
  node_csv_samples["CSV samples<br/>[HELLO.csv]"]
end

subgraph group_storage["Persistence"]
  node_db_helper["Database access<br/>[database_helper.py]"]
  node_mysql[("MySQL database")]
  node_history_view["History viewer<br/>[view_history.py]"]
end

subgraph group_services["Event Services"]
  node_express["Express event API<br/>[server.js]"]
  node_kafka_api["Kafka event API<br/>[server.js]"]
  node_kafka["Kafka broker"]
end

node_user(("Sign user"))

node_user -->|"shows signs"| node_camera
node_entry -->|"renders"| node_app
node_app -->|"renders"| node_camera
node_app -->|"renders"| node_signs
node_camera -->|"posts frames"| node_api
node_api -.->|"detects hands"| node_hand_detection
node_hand_detection -.->|"extracts landmarks"| node_landmarks
node_landmarks -.->|"classifies features"| node_classification
node_classification -.->|"returns recognition"| node_camera
node_api -->|"looks up and saves"| node_db_helper
node_db_helper -->|"queries and records"| node_mysql
node_training -.->|"trains from"| node_csv_samples
node_training_all -.->|"trains from"| node_samples
node_two_hand_training -.->|"trains from"| node_samples
node_data_collection -.->|"collects samples"| node_samples
node_two_hand_collection -.->|"collects samples"| node_samples
node_dataset_extraction -.->|"extracts clips"| node_samples
node_selected_extraction -.->|"extracts clips"| node_samples
node_api -.->|"publishes events"| node_kafka
node_express -->|"publishes events"| node_kafka
node_kafka_api -->|"publishes events"| node_kafka

click node_camera "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/CameraStage.jsx"
click node_app "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/App.jsx"
click node_entry "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/main.jsx"
click node_signs "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/Signs.jsx"
click node_api "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/app.py"
click node_hand_detection "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/app.py"
click node_landmarks "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/app.py"
click node_classification "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/app.py"
click node_hand_tracking "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/hand_tracking.py"
click node_recognizer "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/recognize.py"
click node_data_collection "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/collect_data.py"
click node_two_hand_collection "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/collect_two_hand.py"
click node_dataset_extraction "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/extract_dataset.py"
click node_selected_extraction "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/extract_selected.py"
click node_training "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/train_model.py"
click node_training_all "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/train_model_all.py"
click node_two_hand_training "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/train_two_hand.py"
click node_samples "https://github.com/saranya-aluru/signova-dbms-project/tree/main/project/isl_dataset"
click node_csv_samples "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/HELLO.csv"
click node_db_helper "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/database_helper.py"
click node_history_view "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/view_history.py"
click node_express "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/services/express-service/server.js"
click node_kafka_api "https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/services/kafka-service/server.js"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_camera,node_app,node_entry,node_signs,node_user toneBlue
class node_api,node_hand_detection,node_landmarks,node_classification,node_hand_tracking,node_recognizer toneAmber
class node_data_collection,node_two_hand_collection,node_dataset_extraction,node_selected_extraction,node_training,node_training_all,node_two_hand_training,node_samples,node_csv_samples toneMint
class node_db_helper,node_mysql,node_history_view toneRose
class node_express,node_kafka_api,node_kafka toneIndigo
```

## Components

### Recognition Interface

- [Camera capture](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/CameraStage.jsx): `project/signova/src/CameraStage.jsx`
- [Recognition UI](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/App.jsx): `project/signova/src/App.jsx`
- [React entry](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/main.jsx): `project/signova/src/main.jsx`
- [Sign library](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/signova/src/Signs.jsx): `project/signova/src/Signs.jsx`

### Recognition Backend

- [Flask API](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/app.py): `project/app.py`
- [Hand detection](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/app.py): `project/app.py`
- [Landmark processing](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/app.py): `project/app.py`
- [Sign classification](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/app.py): `project/app.py`
- [Hand tracking](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/hand_tracking.py): `project/hand_tracking.py`
- [Standalone recognizer](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/recognize.py): `project/recognize.py`

### Data and Models

- [Sample collection](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/collect_data.py): `project/collect_data.py`
- [Two-hand collection](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/collect_two_hand.py): `project/collect_two_hand.py`
- [Dataset extraction](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/extract_dataset.py): `project/extract_dataset.py`
- [Selected extraction](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/extract_selected.py): `project/extract_selected.py`
- [Model training](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/train_model.py): `project/train_model.py`
- [Expanded training](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/train_model_all.py): `project/train_model_all.py`
- [Two-hand training](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/train_two_hand.py): `project/train_two_hand.py`
- [Gesture samples](https://github.com/saranya-aluru/signova-dbms-project/tree/main/project/isl_dataset): `project/isl_dataset`
- [CSV samples](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/HELLO.csv): `project/HELLO.csv`

### Persistence

- [Database access](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/database_helper.py): `project/database_helper.py`
- **MySQL database**
- [History viewer](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/view_history.py): `project/view_history.py`

### Event Services

- [Express event API](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/services/express-service/server.js): `project/services/express-service/server.js`
- [Kafka event API](https://github.com/saranya-aluru/signova-dbms-project/blob/main/project/services/kafka-service/server.js): `project/services/kafka-service/server.js`
- **Kafka broker**

### Other components

- **Sign user**

## Connections

- Sign user → Camera capture: shows signs (evidence: `README.md`)
- React entry → Recognition UI: renders (evidence: `project/signova/src/main.jsx`)
- Recognition UI → Camera capture: renders (evidence: `project/signova/src/App.jsx`)
- Recognition UI → Sign library: renders (evidence: `project/signova/src/App.jsx`)
- Camera capture → Flask API: posts frames (evidence: `project/signova/src/CameraStage.jsx`)
- Flask API → Hand detection: detects hands (evidence: `project/app.py`)
- Hand detection → Landmark processing: extracts landmarks (evidence: `project/app.py`)
- Landmark processing → Sign classification: classifies features (evidence: `project/app.py`)
- Sign classification → Camera capture: returns recognition
- Flask API → Database access: looks up and saves (evidence: `project/app.py`)
- Database access → MySQL database: queries and records (evidence: `project/database_helper.py`)
- Model training → CSV samples: trains from
- Expanded training → Gesture samples: trains from
- Two-hand training → Gesture samples: trains from
- Sample collection → Gesture samples: collects samples
- Two-hand collection → Gesture samples: collects samples
- Dataset extraction → Gesture samples: extracts clips
- Selected extraction → Gesture samples: extracts clips
- Flask API → Kafka broker: publishes events (evidence: `README.md`)
- Express event API → Kafka broker: publishes events (evidence: `project/services/express-service/server.js`)
- Kafka event API → Kafka broker: publishes events (evidence: `project/services/kafka-service/server.js`)
