# jamwalshah/surya_pg_dbda architecture

> Architecture diagram of the GitHub repository jamwalshah/surya_pg_dbda, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-21). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/jamwalshah/surya_pg_dbda
- Repository: https://github.com/jamwalshah/surya_pg_dbda

## Overview

This repository is a collection of PG-DBDA coursework and examples, not one integrated application. Its sampled runtime workflows include standalone Java exercises, Hadoop MapReduce jobs, NLP experiments, and a statistics assignment. Hadoop jobs read supplied data and write results; the NLP scripts demonstrate text preparation and vectorization or Word2Vec; the statistics notebook-style script loads and analyzes bike-sharing data. These branches are independent. The graph emphasizes documented capabilities and sampled behavior; unsampled files are represented only where the tree or SOURCE INDEX supports them.

Main entry points: [`module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java`](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/MapInnerJoin.java) (Inner map join), [`module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapJoin.java`](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/MapJoin.java) (Map-side join), [`module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/CityAvg2.java`](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/CityAvg2.java) (City averages), [`module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MyPartitioner.java`](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/MyPartitioner.java) (Custom partition job)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_java["Java coursework"]
  node_bank["Bank console<br/>[07.02 Bank.java]"]
  node_java_exercises["Java exercises"]
end

subgraph group_hadoop["Hadoop analytics"]
  node_city_avg["City averages<br/>[CityAvg2.java]"]
  node_partitioner["Custom partition job<br/>[MyPartitioner.java]"]
  node_map_join["Map-side join<br/>[MapJoin.java]"]
  node_inner_join["Inner map join<br/>[MapInnerJoin.java]"]
  node_reduce_join["Reduce-side join<br/>[ReduceJoin.java]"]
end

subgraph group_nlp["NLP experiments"]
  node_text_clean["Text preparation"]
  node_bow["Bag of words"]
  node_word2vec["Word2Vec model"]
end

subgraph group_stats["Statistical analysis"]
  node_bike_analysis["Bike data analysis"]
end

node_learner(("Course user"))
node_hadoop_user(("Job user"))
node_hadoop_data["Input data"]
node_hadoop_results["Output files"]
node_text_sample["Text sample"]
node_bike_data["Bike dataset"]

node_learner -->|"uses menu"| node_bank
node_learner -.->|"runs examples"| node_java_exercises
node_hadoop_user -->|"runs job"| node_city_avg
node_hadoop_user -->|"runs job"| node_partitioner
node_hadoop_user -->|"runs job"| node_map_join
node_hadoop_user -->|"runs job"| node_inner_join
node_hadoop_user -->|"runs job"| node_reduce_join
node_hadoop_data -->|"reads input"| node_city_avg
node_city_avg -->|"writes output"| node_hadoop_results
node_hadoop_data -->|"reads input"| node_partitioner
node_partitioner -->|"writes output"| node_hadoop_results
node_hadoop_data -->|"reads input"| node_map_join
node_map_join -->|"writes output"| node_hadoop_results
node_hadoop_data -->|"reads input"| node_inner_join
node_inner_join -->|"references class"| node_map_join
node_inner_join -->|"writes output"| node_hadoop_results
node_hadoop_data -->|"reads inputs"| node_reduce_join
node_reduce_join -->|"writes output"| node_hadoop_results
node_text_sample -->|"preprocesses"| node_text_clean
node_text_clean -->|"vectorizes"| node_bow
node_text_sample -->|"trains model"| node_word2vec
node_bike_data -->|"loads dataset"| node_bike_analysis

click node_bank "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_4_OOPJ8/OOPJ8_Notes%20MalkeetSingh/07.02%20Bank.java"
click node_java_exercises "https://github.com/jamwalshah/surya_pg_dbda/tree/main/module_4_OOPJ8/OOPJ8_Assignments%20MalkeetSingh"
click node_city_avg "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/CityAvg2.java"
click node_partitioner "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/MyPartitioner.java"
click node_map_join "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/MapJoin.java"
click node_inner_join "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/MapInnerJoin.java"
click node_reduce_join "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/ReduceJoin.java"
click node_text_clean "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_x1_TopUpSessions/TopUpSessions_Notes%20SudeepBharghav/05.02%20TopupSessions-%20Day05%20-%20file1.py"
click node_bow "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_x1_TopUpSessions/TopUpSessions_Notes%20SudeepBharghav/05.02%20TopupSessions-%20Day05%20-%20file1.py"
click node_word2vec "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_x1_TopUpSessions/TopUpSessions_Notes%20SudeepBharghav/05.03%20TopupSessions-%20Day05%20-%20word2vect.py"
click node_bike_analysis "https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_6_AdvancedAnalyticsUsingStatistics/AdvancedAnalyticsUsingStatistics_Assignments%20CDAC/03.04%20vineeta_assignment.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_bank,node_java_exercises,node_learner,node_hadoop_user toneBlue
class node_city_avg,node_partitioner,node_map_join,node_inner_join,node_reduce_join toneAmber
class node_text_clean,node_bow,node_word2vec toneMint
class node_bike_analysis toneRose
class node_hadoop_data,node_hadoop_results,node_text_sample,node_bike_data toneIndigo
```

## Components

### Java coursework

- [Bank console](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_4_OOPJ8/OOPJ8_Notes%20MalkeetSingh/07.02%20Bank.java): `module_4_OOPJ8/OOPJ8_Notes MalkeetSingh/07.02 Bank.java`
- [Java exercises](https://github.com/jamwalshah/surya_pg_dbda/tree/main/module_4_OOPJ8/OOPJ8_Assignments%20MalkeetSingh): `module_4_OOPJ8/OOPJ8_Assignments MalkeetSingh`

### Hadoop analytics

- [City averages](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/CityAvg2.java): `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/CityAvg2.java`
- [Custom partition job](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/MyPartitioner.java): `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MyPartitioner.java`
- [Map-side join](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/MapJoin.java): `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapJoin.java`
- [Inner map join](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/MapInnerJoin.java): `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java`
- [Reduce-side join](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_5_BigDataTechnologies/BigDataTechnologies_Files%20Surya/Hadoop-CDAC/src/ReduceJoin.java): `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/ReduceJoin.java`

### NLP experiments

- [Text preparation](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_x1_TopUpSessions/TopUpSessions_Notes%20SudeepBharghav/05.02%20TopupSessions-%20Day05%20-%20file1.py): `module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.02 TopupSessions- Day05 - file1.py`
- [Bag of words](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_x1_TopUpSessions/TopUpSessions_Notes%20SudeepBharghav/05.02%20TopupSessions-%20Day05%20-%20file1.py): `module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.02 TopupSessions- Day05 - file1.py`
- [Word2Vec model](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_x1_TopUpSessions/TopUpSessions_Notes%20SudeepBharghav/05.03%20TopupSessions-%20Day05%20-%20word2vect.py): `module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.03 TopupSessions- Day05 - word2vect.py`

### Statistical analysis

- [Bike data analysis](https://github.com/jamwalshah/surya_pg_dbda/blob/main/module_6_AdvancedAnalyticsUsingStatistics/AdvancedAnalyticsUsingStatistics_Assignments%20CDAC/03.04%20vineeta_assignment.py): `module_6_AdvancedAnalyticsUsingStatistics/AdvancedAnalyticsUsingStatistics_Assignments CDAC/03.04 vineeta_assignment.py`

### Other components

- **Course user**
- **Job user**
- **Input data**
- **Output files**
- **Text sample**
- **Bike dataset**

## Connections

- Course user → Bank console: uses menu (evidence: `module_4_OOPJ8/OOPJ8_Notes MalkeetSingh/07.02 Bank.java`)
- Course user → Java exercises: runs examples
- Job user → City averages: runs job
- Job user → Custom partition job: runs job (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MyPartitioner.java`)
- Job user → Map-side join: runs job (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapJoin.java`)
- Job user → Inner map join: runs job (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java`)
- Job user → Reduce-side join: runs job
- Input data → City averages: reads input
- City averages → Output files: writes output
- Input data → Custom partition job: reads input (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MyPartitioner.java`)
- Custom partition job → Output files: writes output (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MyPartitioner.java`)
- Input data → Map-side join: reads input (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapJoin.java`)
- Map-side join → Output files: writes output (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapJoin.java`)
- Input data → Inner map join: reads input (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java`)
- Inner map join → Map-side join: references class (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java`)
- Inner map join → Output files: writes output (evidence: `module_5_BigDataTechnologies/BigDataTechnologies_Files Surya/Hadoop-CDAC/src/MapInnerJoin.java`)
- Input data → Reduce-side join: reads inputs
- Reduce-side join → Output files: writes output
- Text sample → Text preparation: preprocesses (evidence: `module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.02 TopupSessions- Day05 - file1.py`)
- Text preparation → Bag of words: vectorizes (evidence: `module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.02 TopupSessions- Day05 - file1.py`)
- Text sample → Word2Vec model: trains model (evidence: `module_x1_TopUpSessions/TopUpSessions_Notes SudeepBharghav/05.03 TopupSessions- Day05 - word2vect.py`)
- Bike dataset → Bike data analysis: loads dataset (evidence: `module_6_AdvancedAnalyticsUsingStatistics/AdvancedAnalyticsUsingStatistics_Assignments CDAC/03.04 vineeta_assignment.py`)
