# hkuennemann/msc_ba_projects architecture

> Architecture diagram of the GitHub repository hkuennemann/msc_ba_projects, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-09-27). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/hkuennemann/msc_ba_projects
- Repository: https://github.com/hkuennemann/msc_ba_projects

## Overview

##### Project Type and Purpose
- This is a monolithic “portfolio” repository structured as folders by course, each containing one or more projects.
- Purpose: showcase data-analysis, ML, programming and visualization workflows.

##### File Structure
- Top-level directories = course names (e.g., Advanced Data Analysis, Machine Learning, Web & Cloud Computing).
- Inside each: subfolders per project, containing:
- Raw/input data (CSV, XLSX, images, XML, etc.)
- Processing code (Jupyter notebooks, Python/R scripts, JS/HTML/CSS)
- Documentation (README.md, LICENSE, Sphinx docs, tests)
- Outputs (dashboards, HTML exports, notebooks, model artifacts).

1. Data Sources
- Raw files: CSVs, Excel, images, XML, API-fetched JSON.
- External API service (API-Football) in “League Lense” web project.
2. Processing Engines
- Python notebooks & scripts (Pandas, NumPy, Spark, Dask).
- R scripts/notebooks for Network Analytics.
- Jupyter front-end as interactive orchestration.
3. Analytical Workflows
- ETL pipelines in Data Curation (Extract → Transform → Load).
- ML pipelines in Machine Learning (pre-processing → training → evaluation → tuning).
- Graph analytics in Advanced Data Analysis (Bitcoin network) and Network Analytics (igraph).
4. Documentation & Testing
- Sphinx docs & unit tests in Advanced Programming (Project Icaras).
- README and LICENSE across modules.
5. Visualizations & Outputs
- Tableau dashboards (Tableau TWBX files) in Data Visualization.
- Static HTML/JS front-end in Web & Cloud Computing.
- Notebook HTML/exports (Rmd → HTML) in Network Analytics.

- From “Data Sources” → into each project’s “Processing Engine.”
- In Data Visualization: raw CSV → data-cleaning script → Tableau workbook → interactive dashboard.
- In Advanced Programming: code modules → tests → Sphinx → built HTML docs.

c. Architectural Patterns & Principles:
- Monorepo with modular, folder-based separation by course/project.
- Reproducible workflows: each project isolated with its own data folder, environment file (environment.yml).
- ETL pattern in Data Curation.
- ML pipeline pattern: Data → Feature Engineering → Model Training → Validation → Deployment artifacts.
- MVC-like separation in Web & Cloud Computing: static HTML/CSS/JS view, fetch calls as controller logic, API as model.
- Documentation-first in Advanced Programming: docs in Sphinx, tests ensure code quality.

d. Key Technologies & Frameworks (annotate next to each component):
- Python ecosystem: Pandas, NumPy, Matplotlib, scikit-learn, TensorFlow/Keras, cuDF/cuGraph (GPU).
- Big data: Spark, Dask.
- R ecosystem: igraph, ggplot2.
- JS ecosystem: fetch API, Promises, async/await.
- Visualization: Tableau.
- Documentation: Sphinx, pytest.
- Environments: Conda (environment.yml).

## Diagram (Mermaid)

```mermaid
graph TB
    %% Data Sources Layer
    subgraph "Data Sources" 
        direction TB
        A_OlyCSV["Olympic Games CSV"]:::dataSources
        A_BitcoinRaw["Bitcoin Raw Data"]:::dataSources
        A_ChildrenCSV["Children Weight CSV"]:::dataSources
        A_CancerCSV["Cancer Classification CSV"]:::dataSources
        DC_TitanicExcel["Titanic Excel"]:::dataSources
        DC_CarsCSV["Cars Dataset CSVs"]:::dataSources
        DC_FragranceCSV["Fragrance CSV"]:::dataSources
        DC_MovieRecCSVs["Movie Recommendation CSVs"]:::dataSources
        DV_OlyFinalCSV["Olympic Dashboard CSV"]:::dataSources
        ML_InsuranceCSV["Insurance Data CSV"]:::dataSources
        ML_BloodXML["BloodCellAI Annotations XML"]:::dataSources
        ML_BloodImg1["BloodCellAI Images Set1"]:::dataSources
        ML_BloodImg2["BloodCellAI Images Set2"]:::dataSources
    end

    %% Processing Engines Layer
    subgraph "Processing Engines" 
        direction TB
        PE_Jupyter["Jupyter Notebooks"]:::processing
        PE_DVScript["DV Cleaning Script"]:::processing
        PE_RNotebooks["R Scripts/Notebooks"]:::processing
        PE_JS["JavaScript Front-end Logic"]:::processing
    end

    %% Analytical Workflows Layer
    subgraph "Analytical Workflows" 
        direction TB
        AW_ETL["ETL Pipelines"]:::workflow
        AW_MLPipe["ML Pipeline"]:::workflow
        AW_GPUGraph["GPU Graph Analytics"]:::workflow
    end

    %% Documentation & Testing Layer
    subgraph "Documentation & Testing" 
        direction TB
        DT_Sphinx["Sphinx Documentation"]:::docs
        DT_Tests["Unit Tests"]:::docs
        DT_Readme["README & LICENSE"]:::docs
    end

    %% Visualizations & Outputs Layer
    subgraph "Visualizations & Outputs"
        direction TB
        VO_Tableau1["Olympic Tableau Dashboard"]:::outputs
        VO_Tableau2["Host Country Dashboard"]:::outputs
        VO_HTMLViews["Static HTML Views"]:::outputs
        VO_RHTML["Rmd HTML Exports"]:::outputs
    end

    %% Relationships
    A_OlyCSV -->|"reads CSV"| PE_Jupyter
    A_ChildrenCSV -->|"reads CSV"| PE_Jupyter
    A_CancerCSV -->|"reads CSV"| PE_Jupyter
    A_BitcoinRaw -->|"reads notebook"| PE_Jupyter
    DC_TitanicExcel -->|"reads Excel"| AW_ETL
    DC_CarsCSV -->|"reads CSVs"| AW_ETL
    DC_FragranceCSV -->|"reads CSV"| AW_ETL
    DC_MovieRecCSVs -->|"reads CSVs"| AW_ETL
    PE_Jupyter -->|"executes workflows"| AW_MLPipe
    AW_MLPipe -->|"produces models"| VO_Tableau1
    AW_GPUGraph -->|"graph analysis"| VO_RHTML
    PE_DVScript -->|"cleans data"| VO_Tableau1
    PE_JS -->|"fetches JSON"| AW_MLPipe
    AW_ETL -->|"outputs cleaned data"| VO_Tableau1
    DT_Tests -->|"validate code"| DT_Sphinx
    DT_Sphinx -->|"build HTML docs"| VO_RHTML
    VO_Tableau1 -->|"dashboard"| VO_Tableau2

    %% Click events for Data Sources
    click A_OlyCSV "https://github.com/hkuennemann/msc_ba_projects/blob/main/Advanced Data Analysis/1.OlympicGames_analysis/data/athlete_events.csv"
    click A_BitcoinRaw "https://github.com/hkuennemann/msc_ba_projects/blob/main/Advanced Data Analysis/4.Bitcoin_analysis/bitcoin_analysis.ipynb"
    click A_ChildrenCSV "https://github.com/hkuennemann/msc_ba_projects/blob/main/Advanced Data Analysis/2.Children_weight_prediction/data/children.csv"
    click A_CancerCSV "https://github.com/hkuennemann/msc_ba_projects/blob/main/Advanced Data Analysis/3.Cancer_classification/data/breastcancer.csv"
    click DC_TitanicExcel "https://github.com/hkuennemann/msc_ba_projects/blob/main/Data Curation/4.Titanic_analysis/titanic.xlsx"
    click DC_CarsCSV "https://github.com/hkuennemann/msc_ba_projects/blob/main/Data Curation/5.Cars_analysis/cars_dataset_part1.csv"
    click DC_FragranceCSV "https://github.com/hkuennemann/msc_ba_projects/blob/main/Data Curation/6.Fragrance_analysis/fragrance.csv"
    click DC_MovieRecCSVs "https://github.com/hkuennemann/msc_ba_projects/blob/main/Data Curation/3.Movie_recommendation/movies_dc.csv"
    click DV_OlyFinalCSV "https://github.com/hkuennemann/msc_ba_projects/blob/main/Data Visualization/Olympic Games Dashboard/Geo_Dominance_Dashboard&Data/Olympic_data_final.csv"
    click ML_InsuranceCSV "https://github.com/hkuennemann/msc_ba_projects/blob/main/Machine Learning/1.ABC_Insurance/ABC_df_customer.csv"
    click ML_BloodXML "https://github.com/hkuennemann/msc_ba_projects/blob/main/Machine Learning/6.BloodCellAI/Data/dataset-master/Annotations/BloodImage_00000.xml"
    click ML_BloodImg1 "https://github.com/hkuennemann/msc_ba_projects/tree/main/Machine Learning/6.BloodCellAI/Data/dataset-master/JPEGImages/"
    click ML_BloodImg2 "https://github.com/hkuennemann/msc_ba_projects/tree/main/Machine Learning/6.BloodCellAI/Data/dataset2-master/images/TRAIN/EOSINOPHIL/"

    %% Click events for Processing Engines
    click PE_Jupyter "https://github.com/hkuennemann/msc_ba_projects/blob/main/Advanced Data Analysis/1.OlympicGames_analysis/olympicGames_analysis.ipynb"
    click PE_DVScript "https://github.com/hkuennemann/msc_ba_projects/blob/main/Data Visualization/Olympic Games Dashboard/Data Cleaning/Python_Script_DV.py"
    click PE_RNotebooks "https://github.com/hkuennemann/msc_ba_projects/blob/main/Network Analytics/Dating_platforms/Dating_platforms.Rmd"
    click PE_JS "https://github.com/hkuennemann/msc_ba_projects/blob/main/Web & Cloud Computing/League Lense/scripts/script.js"

    %% Click events for Analytical Workflows
    click AW_ETL "https://github.com/hkuennemann/msc_ba_projects/blob/main/Data Curation/2.Covid_analysis/covid_analysis.ipynb"
    click AW_MLPipe "https://github.com/hkuennemann/msc_ba_projects/blob/main/Machine Learning/3.VinifyTech/VinifyTech.ipynb"
    click AW_GPUGraph "https://github.com/hkuennemann/msc_ba_projects/blob/main/Advanced Data Analysis/4.Bitcoin_analysis/bitcoin_analysis.ipynb"

    %% Click events for Documentation & Testing
    click DT_Sphinx "https://github.com/hkuennemann/msc_ba_projects/blob/main/Advanced Programming/Project Icaras/docs/index.rst"
    click DT_Tests "https://github.com/hkuennemann/msc_ba_projects/blob/main/Advanced Programming/Project Icaras/source/Test/test_distances.py"
    click DT_Readme "https://github.com/hkuennemann/msc_ba_projects/blob/main/Advanced Programming/Audio-Transcription-Summarization/README.md"

    %% Click events for Visualizations & Outputs
    click VO_Tableau1 "https://github.com/hkuennemann/msc_ba_projects/blob/main/Data Visualization/Olympic Games Dashboard/Geo_Dominance_Dashboard&Data/Geo_dominance.twbx"
    click VO_Tableau2 "https://github.com/hkuennemann/msc_ba_projects/blob/main/Data Visualization/Olympic Games Dashboard/Host_country_Dashboard&Data/Host_effect.twbx"
    click VO_HTMLViews "https://github.com/hkuennemann/msc_ba_projects/blob/main/Web & Cloud Computing/League Lense/index.html"
    click VO_RHTML "https://github.com/hkuennemann/msc_ba_projects/blob/main/Network Analytics/Dating_platforms/Dating_platforms.html"

    %% Styles
    classDef dataSources fill:#E0F7FA,stroke:#006064,stroke-width:1px;
    classDef processing fill:#E8F5E9,stroke:#1B5E20,stroke-width:1px;
    classDef workflow fill:#FFF3E0,stroke:#E65100,stroke-width:1px;
    classDef docs fill:#F3E5F5,stroke:#4A148C,stroke-width:1px;
    classDef outputs fill:#FCE4EC,stroke:#880E4F,stroke-width:1px;
```
