# vermashaurya/data-analysis architecture

> Architecture diagram of the GitHub repository vermashaurya/data-analysis, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-05-21). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/vermashaurya/data-analysis
- Repository: https://github.com/vermashaurya/data-analysis

## Overview

##### Project Type & Purpose
- This is a monorepo of standalone data-analysis tools written in Python.
- It provides:
- Image annotation (YOLO-based object detection)
- Classification algorithms (ID3 Decision Tree)
- Performance metrics for linear & logistic regression
- Time-series analysis (AutoRegressive models)
- There is no traditional frontend/backend; each folder is a self-contained component that ingests data, processes it, and produces output (plots, CSVs, annotated images, dashboards).

##### File Structure & High‐Level Components
- Top‐level directories = major modules:
- Classification/DecisionTree
- Image-annotation
- Performance-Metrics/Linear-Regression
- Performance-Metrics/LogisticRegression
- TimeSeries-Analysis
- Common patterns: each module contains:
- Data inputs (CSV, cfg, weights, names)
- Processing scripts or notebooks (.py, .ipynb)
- Outputs (plots, .dot files, .pdf, Streamlit UI)
- Config/build files:
- model weights & config (yolov3.weights, .cfg, coco.names)
- dependencies called out in README (numpy, pandas, opencv, streamlit)

##### Key Architecture Insights from README
- Dependencies per module:
- Image-annotation: OpenCV, NumPy, Pillow, YOLO assets
- Linear/Logistic Regression: numpy, pandas, Streamlit (for logistic)
- Time-Series: pandas (inferred), statsmodels or similar
- Execution modes:
- CLI scripts (main.py, regression.py, logisticregression.py)
- Jupyter notebooks for exploratory analysis
- Streamlit app for interactive logistic regression metrics

- classification CSVs
- datasets for regression & time series
- images and YOLO config/weights
2. Preprocessing Layer (rectangles)
- image loader & annotator (main.py)
- data cleaners embedded in notebooks/scripts
3. Modeling Engines (rectangles)
- Decision Tree (decisiontree.py)
- Linear Regression (linearregression.py)
- Logistic Regression (logisticregression.py)
- AutoRegressive Model (notebook)
4. Evaluation & Metrics (rectangles)
- MSE, RMSE, MAE, R², Adj-R² (Linear)
- MSLE, MAPE (Logistic)
- Jupyter Notebooks
- Streamlit dashboard
- YOLO weight files (downloaded)
- pip-installed Python libraries
- Data → Preprocessing
- Preprocessing → Modeling
- Modeling → Evaluation Metrics
- Evaluation Metrics → Visualization/UI
- Visualization/UI → End user/Analyst
c. Architectural Patterns & Principles
- Modular, folder-per-component
- Separation of concerns: data ingestion vs. model vs. UI
- Reusable utilities (could be common library down the road)
d. Key Technologies & Frameworks
- Python scripts & Jupyter notebooks
- OpenCV, NumPy, pandas, statsmodels (inferred)
- Streamlit for interactive dashboards
- YOLOv3 object detection framework

## Diagram (Mermaid)

```mermaid
flowchart TD
    %% Data Sources
    subgraph "Data Sources"
        direction TB
        classifierCsv["classifier.csv"]:::data
        datasetCsv["dataset.csv"]:::data
        dailyCsv["daily-min-temperatures.csv"]:::data
        yolov3Cfg["yolov3.cfg"]:::data
        cocoNames["coco.names"]:::data
    end

    %% Modeling Engines
    subgraph "Modeling Engines"
        direction TB
        DT["Decision Tree Engine<br/>(decisiontree.py)"]:::compute
        LR["Linear Regression Engine<br/>(linearregression.py)"]:::compute
        LGR["Logistic Regression Engine<br/>(logisticregression.py)"]:::compute
        AR["AutoRegressive Model Notebook<br/>(AutoRegressive Model.ipynb)"]:::compute
        IMG["Image Annotator<br/>(main.py)"]:::compute
    end

    %% Evaluation & Metrics
    subgraph "Evaluation & Metrics"
        direction TB
        LinMetrics["Linear Metrics<br/>(MSE, RMSE, MAE, R²)"]:::metrics
        LogMetrics["Logistic Metrics<br/>(MSLE, MAPE)"]:::metrics
    end

    %% Visualization/UI
    subgraph "Visualization/UI"
        direction TB
        DTNB["Decision Tree Notebook<br/>(decision_tree.dot)"]:::ui
        RegNB["Regression Notebook<br/>(Regression-notebook.ipynb)"]:::ui
        LogNB["Logistic Notebook<br/>(Logistic-Notebook.ipynb)"]:::ui
        ARNB["Time Series Notebook"]:::ui
        Streamlit["Streamlit Dashboard<br/>(streamlit.pdf)"]:::ui
    end

    %% End User
    Analyst["Analyst"]:::external

    %% Data to Modeling
    classifierCsv -->|".csv"| DT
    datasetCsv -->|".csv"| LR
    datasetCsv -->|".csv"| LGR
    dailyCsv -->|".csv"| AR
    yolov3Cfg -->|".cfg"| IMG
    cocoNames -->|".names"| IMG

    %% Modeling to Metrics
    LR -->|"predictions"| LinMetrics
    LGR -->|"predictions"| LogMetrics

    %% Metrics to UI
    DT -->|".dot"| DTNB
    LinMetrics -->|".ipynb"| RegNB
    LogMetrics -->|".ipynb"| LogNB
    AR -->|".ipynb"| ARNB
    LogMetrics -->|".pdf"| Streamlit

    %% UI to Analyst
    DTNB -->|view| Analyst
    RegNB -->|view| Analyst
    LogNB -->|view| Analyst
    ARNB -->|view| Analyst
    Streamlit -->|view| Analyst

    %% Click Events
    click DT "https://github.com/vermashaurya/data-analysis/blob/main/Classification/DecisionTree/decisiontree.py"
    click classifierCsv "https://github.com/vermashaurya/data-analysis/blob/main/Classification/classifier.csv"
    click DTNB "https://github.com/vermashaurya/data-analysis/blob/main/Classification/DecisionTree/decision_tree.dot"
    click IMG "https://github.com/vermashaurya/data-analysis/blob/main/Image-annotation/main.py"
    click yolov3Cfg "https://github.com/vermashaurya/data-analysis/blob/main/Image-annotation/yolov3.cfg"
    click cocoNames "https://github.com/vermashaurya/data-analysis/blob/main/Image-annotation/coco.names"
    click LR "https://github.com/vermashaurya/data-analysis/blob/main/Performance-Metrics/Linear-Regression/linearregression.py"
    click RegNB "https://github.com/vermashaurya/data-analysis/blob/main/Performance-Metrics/Linear-Regression/Regression-notebook.ipynb"
    click datasetCsv "https://github.com/vermashaurya/data-analysis/blob/main/Performance-Metrics/dataset.csv"
    click LGR "https://github.com/vermashaurya/data-analysis/blob/main/Performance-Metrics/LogisticRegression/logisticregression.py"
    click LogNB "https://github.com/vermashaurya/data-analysis/blob/main/Performance-Metrics/LogisticRegression/Logistic-Notebook.ipynb"
    click Streamlit "https://github.com/vermashaurya/data-analysis/blob/main/Performance-Metrics/LogisticRegression/streamlit.pdf"
    click AR "https://github.com/vermashaurya/data-analysis/blob/main/TimeSeries-Analysis/AutoRegressive Model.ipynb"
    click dailyCsv "https://github.com/vermashaurya/data-analysis/blob/main/TimeSeries-Analysis/daily-min-temperatures.csv"
    click README["README.md"] "README.md"

    %% Styles
    classDef data fill:#D0E6FF,stroke:#3388CC,stroke-width:1px
    classDef compute fill:#DFFFD0,stroke:#33AA00,stroke-width:1px
    classDef metrics fill:#FFE6B3,stroke:#FFAA00,stroke-width:1px
    classDef ui fill:#E6D0FF,stroke:#AA33CC,stroke-width:1px
    classDef external fill:#F0F0F0,stroke:#888888,stroke-width:1px,stroke-dasharray: 2 2
```
