# mithun-j/mini-project architecture

> Architecture diagram of the GitHub repository mithun-j/mini-project, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-16). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/mithun-j/mini-project
- Repository: https://github.com/mithun-j/mini-project

## Overview

This repository is a batch crop-yield ETL and exploratory-analysis application. A user runs the ETL entry point to read and audit the historical CSV, clean and validate rows, engineer agricultural features, then persist a prepared dataset and summary reports. A separate EDA entry point reads that dataset and coordinates structure, outlier, correlation, and visualization analyses. The README documents the broader reporting and visualization capabilities; the sampled code shows the main orchestrators and several outputs, but not every report-writing detail.

Main entry points: [`eda.py`](https://github.com/mithun-j/mini-project/blob/main/eda.py) (EDA Runner), [`pipeline.py`](https://github.com/mithun-j/mini-project/blob/main/pipeline.py) (ETL Runner), [`src/etl/load.py`](https://github.com/mithun-j/mini-project/blob/main/src/etl/load.py) (Persist and Report), [`reports`](https://github.com/mithun-j/mini-project/tree/main/reports) (ETL and EDA Reports)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_etl["ETL Processing"]
  node_etl_runner["ETL Runner<br/>[pipeline.py]"]
  node_extract["Extract and Audit<br/>[extract.py]"]
  node_clean["Clean and Validate<br/>[clean.py]"]
  node_features["Engineer Features<br/>[features.py]"]
  node_load["Persist and Report<br/>[load.py]"]
end

subgraph group_eda["Exploratory Analysis"]
  node_eda_runner["EDA Runner<br/>[eda.py]"]
  node_structure["Structure Analysis<br/>[structure.py]"]
  node_outliers["Outlier Analysis<br/>[outliers.py]"]
  node_correlations["Correlation Analysis<br/>[correlations.py]"]
  node_visuals["EDA Visualizations<br/>[visuals.py]"]
end

subgraph group_artifacts["Data Artifacts"]
  node_raw_csv["Raw Crop Data<br/>[crop_yield.csv]"]
  node_prepared_csv["Prepared Dataset"]
  node_reports["ETL and EDA Reports"]
  node_figures["EDA Figures"]
end

node_user(("User"))

node_user -->|"runs"| node_etl_runner
node_etl_runner -->|"calls"| node_extract
node_etl_runner -->|"calls"| node_clean
node_etl_runner -->|"calls"| node_features
node_etl_runner -->|"calls"| node_load
node_extract -->|"reads"| node_raw_csv
node_load -->|"writes"| node_prepared_csv
node_load -->|"generates"| node_reports
node_user -->|"runs"| node_eda_runner
node_eda_runner -->|"reads"| node_prepared_csv
node_eda_runner -->|"calls"| node_structure
node_eda_runner -->|"calls"| node_outliers
node_eda_runner -->|"calls"| node_correlations
node_eda_runner -->|"calls"| node_visuals
node_outliers -->|"writes summary"| node_reports
node_visuals -->|"writes plots"| node_figures
node_eda_runner -->|"writes summary"| node_reports

click node_etl_runner "https://github.com/mithun-j/mini-project/blob/main/pipeline.py"
click node_extract "https://github.com/mithun-j/mini-project/blob/main/src/etl/extract.py"
click node_clean "https://github.com/mithun-j/mini-project/blob/main/src/etl/clean.py"
click node_features "https://github.com/mithun-j/mini-project/blob/main/src/etl/features.py"
click node_load "https://github.com/mithun-j/mini-project/blob/main/src/etl/load.py"
click node_eda_runner "https://github.com/mithun-j/mini-project/blob/main/eda.py"
click node_structure "https://github.com/mithun-j/mini-project/blob/main/src/eda/structure.py"
click node_outliers "https://github.com/mithun-j/mini-project/blob/main/src/eda/outliers.py"
click node_correlations "https://github.com/mithun-j/mini-project/blob/main/src/eda/correlations.py"
click node_visuals "https://github.com/mithun-j/mini-project/blob/main/src/eda/visuals.py"
click node_raw_csv "https://github.com/mithun-j/mini-project/blob/main/raw_data/crop_yield.csv"
click node_prepared_csv "https://github.com/mithun-j/mini-project/blob/main/output/preprocessed_data.csv"
click node_reports "https://github.com/mithun-j/mini-project/tree/main/reports"
click node_figures "https://github.com/mithun-j/mini-project/tree/main/reports/figures"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_etl_runner,node_extract,node_clean,node_features,node_load,node_user toneBlue
class node_eda_runner,node_structure,node_outliers,node_correlations,node_visuals toneAmber
class node_raw_csv,node_prepared_csv,node_reports,node_figures toneMint
```

## Components

### ETL Processing

- [ETL Runner](https://github.com/mithun-j/mini-project/blob/main/pipeline.py): `pipeline.py`
- [Extract and Audit](https://github.com/mithun-j/mini-project/blob/main/src/etl/extract.py): `src/etl/extract.py`
- [Clean and Validate](https://github.com/mithun-j/mini-project/blob/main/src/etl/clean.py): `src/etl/clean.py`
- [Engineer Features](https://github.com/mithun-j/mini-project/blob/main/src/etl/features.py): `src/etl/features.py`
- [Persist and Report](https://github.com/mithun-j/mini-project/blob/main/src/etl/load.py): `src/etl/load.py`

### Exploratory Analysis

- [EDA Runner](https://github.com/mithun-j/mini-project/blob/main/eda.py): `eda.py`
- [Structure Analysis](https://github.com/mithun-j/mini-project/blob/main/src/eda/structure.py): `src/eda/structure.py`
- [Outlier Analysis](https://github.com/mithun-j/mini-project/blob/main/src/eda/outliers.py): `src/eda/outliers.py`
- [Correlation Analysis](https://github.com/mithun-j/mini-project/blob/main/src/eda/correlations.py): `src/eda/correlations.py`
- [EDA Visualizations](https://github.com/mithun-j/mini-project/blob/main/src/eda/visuals.py): `src/eda/visuals.py`

### Data Artifacts

- [Raw Crop Data](https://github.com/mithun-j/mini-project/blob/main/raw_data/crop_yield.csv): `raw_data/crop_yield.csv`
- [Prepared Dataset](https://github.com/mithun-j/mini-project/blob/main/output/preprocessed_data.csv): `output/preprocessed_data.csv`
- [ETL and EDA Reports](https://github.com/mithun-j/mini-project/tree/main/reports): `reports`
- [EDA Figures](https://github.com/mithun-j/mini-project/tree/main/reports/figures): `reports/figures`

### Other components

- **User**

## Connections

- User → ETL Runner: runs (evidence: `pipeline.py`)
- ETL Runner → Extract and Audit: calls (evidence: `pipeline.py`)
- ETL Runner → Clean and Validate: calls (evidence: `pipeline.py`)
- ETL Runner → Engineer Features: calls (evidence: `pipeline.py`)
- ETL Runner → Persist and Report: calls (evidence: `pipeline.py`)
- Extract and Audit → Raw Crop Data: reads (evidence: `src/etl/extract.py`)
- Persist and Report → Prepared Dataset: writes (evidence: `README.md`)
- Persist and Report → ETL and EDA Reports: generates (evidence: `src/etl/load.py`)
- User → EDA Runner: runs (evidence: `eda.py`)
- EDA Runner → Prepared Dataset: reads (evidence: `eda.py`)
- EDA Runner → Structure Analysis: calls (evidence: `eda.py`)
- EDA Runner → Outlier Analysis: calls (evidence: `eda.py`)
- EDA Runner → Correlation Analysis: calls (evidence: `eda.py`)
- EDA Runner → EDA Visualizations: calls (evidence: `eda.py`)
- Outlier Analysis → ETL and EDA Reports: writes summary (evidence: `src/eda/outliers.py`)
- EDA Visualizations → EDA Figures: writes plots (evidence: `README.md`)
- EDA Runner → ETL and EDA Reports: writes summary (evidence: `eda.py`)
