# 22amitdeo/dwdmproject architecture

> Architecture diagram of the GitHub repository 22amitdeo/dwdmproject, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-21). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/22amitdeo/dwdmproject
- Repository: https://github.com/22amitdeo/dwdmproject

## Overview

This repository analyzes agricultural crop prices to characterize volatility and farmer income risk, and also provides a separate modal-price prediction app. The analysis workflow cleans raw records, then runs risk mining, OLAP summaries, visualizations, and insight generation over the cleaned dataset. A warehouse builder creates dimensional tables, while a separate training-and-serving path predicts prices from market details. The README documents these analysis capabilities; the sampled sources show the main orchestration and several analysis, warehouse, and prediction paths, but not every subsystem’s implementation.

Main entry points: [`data/cleaned_crop_prices.csv`](https://github.com/22amitdeo/dwdmproject/blob/main/data/cleaned_crop_prices.csv) (Cleaned Prices), [`run_analysis.py`](https://github.com/22amitdeo/dwdmproject/blob/main/run_analysis.py) (Analysis Runner), [`warehouse/build_warehouse.py`](https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/build_warehouse.py) (Warehouse Builder), [`prediction/model.pkl`](https://github.com/22amitdeo/dwdmproject/blob/main/prediction/model.pkl) (Trained Model)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_prep["Data Preparation"]
  node_raw["Raw Prices<br/>[crop_prices.csv]"]
  node_cleaner["Data Cleaner<br/>[clean_data.py]"]
  node_clean["Cleaned Prices"]
  node_warehouse_builder["Warehouse Builder<br/>[build_warehouse.py]"]
  node_time_dim[("Time Dimension<br/>[time_dimension.csv]")]
  node_location_dim[("Location Dimension")]
  node_crop_dim[("Crop Dimension<br/>[crop_dimension.csv]")]
  node_fact[("Price Facts<br/>[fact_table.csv]")]
end

subgraph group_analysis["Risk Analysis"]
  node_runner["Analysis Runner<br/>[run_analysis.py]"]
  node_mining["Risk Mining<br/>[data_mining.py]"]
  node_olap["OLAP Operations<br/>[olap_operations.py]"]
  node_visuals["Core Charts<br/>[visualizations.py]"]
  node_advanced["Advanced Charts"]
  node_insights["Insight Generator<br/>[insights.py]"]
  node_price_analysis["Price Analysis<br/>[price_analysis.py]"]
end

subgraph group_prediction["Price Prediction"]
  node_model_trainer["Model Trainer<br/>[train_model.py]"]
  node_model[("Trained Model<br/>[model.pkl]")]
  node_app["Prediction App<br/>[app.py]"]
  node_predictor["Prediction Function<br/>[predict.py]"]
  node_evaluator["Model Evaluator<br/>[evaluate_model.py]"]
end

subgraph group_outputs["Analysis Outputs"]
  node_mining_results["Mining Results"]
  node_olap_results["OLAP Results"]
  node_visual_results["Chart Results"]
  node_advanced_results["Advanced Results"]
  node_insight_report["Insight Summary"]
end

node_farmer(("App User"))

node_raw -->|"loads"| node_cleaner
node_cleaner -->|"writes"| node_clean
node_clean -->|"reads"| node_warehouse_builder
node_warehouse_builder -->|"writes"| node_time_dim
node_warehouse_builder -->|"writes"| node_location_dim
node_warehouse_builder -->|"writes"| node_crop_dim
node_warehouse_builder -->|"writes"| node_fact
node_runner -->|"runs"| node_mining
node_runner -->|"runs"| node_olap
node_runner -->|"runs"| node_visuals
node_runner -->|"runs"| node_advanced
node_runner -->|"runs"| node_insights
node_mining -->|"reads"| node_clean
node_mining -->|"writes"| node_mining_results
node_olap -->|"reads"| node_clean
node_olap -->|"writes"| node_olap_results
node_visuals -->|"reads"| node_clean
node_visuals -->|"writes"| node_visual_results
node_advanced -->|"reads"| node_clean
node_advanced -->|"writes"| node_advanced_results
node_insights -->|"reads"| node_clean
node_insights -->|"writes"| node_insight_report
node_model_trainer -->|"reads"| node_clean
node_model_trainer -->|"saves"| node_model
node_farmer -->|"enters details"| node_app
node_app -->|"loads options"| node_clean
node_app -->|"loads"| node_model
node_predictor -->|"loads"| node_model
node_evaluator -->|"loads"| node_model
node_evaluator -->|"reads"| node_clean

click node_raw "https://github.com/22amitdeo/dwdmproject/blob/main/data/crop_prices.csv"
click node_cleaner "https://github.com/22amitdeo/dwdmproject/blob/main/preprocessing/clean_data.py"
click node_clean "https://github.com/22amitdeo/dwdmproject/blob/main/data/cleaned_crop_prices.csv"
click node_warehouse_builder "https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/build_warehouse.py"
click node_time_dim "https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/time_dimension.csv"
click node_location_dim "https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/location_dimension.csv"
click node_crop_dim "https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/crop_dimension.csv"
click node_fact "https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/fact_table.csv"
click node_runner "https://github.com/22amitdeo/dwdmproject/blob/main/run_analysis.py"
click node_mining "https://github.com/22amitdeo/dwdmproject/blob/main/analysis/data_mining.py"
click node_olap "https://github.com/22amitdeo/dwdmproject/blob/main/analysis/olap_operations.py"
click node_visuals "https://github.com/22amitdeo/dwdmproject/blob/main/analysis/visualizations.py"
click node_advanced "https://github.com/22amitdeo/dwdmproject/blob/main/analysis/advanced_visualizations.py"
click node_insights "https://github.com/22amitdeo/dwdmproject/blob/main/analysis/insights.py"
click node_price_analysis "https://github.com/22amitdeo/dwdmproject/blob/main/analysis/price_analysis.py"
click node_mining_results "https://github.com/22amitdeo/dwdmproject/tree/main/results/data_mining"
click node_olap_results "https://github.com/22amitdeo/dwdmproject/tree/main/results/olap"
click node_visual_results "https://github.com/22amitdeo/dwdmproject/tree/main/results/visualizations"
click node_advanced_results "https://github.com/22amitdeo/dwdmproject/tree/main/results/advanced_visualizations"
click node_insight_report "https://github.com/22amitdeo/dwdmproject/blob/main/results/insights_summary.txt"
click node_model_trainer "https://github.com/22amitdeo/dwdmproject/blob/main/prediction/train_model.py"
click node_model "https://github.com/22amitdeo/dwdmproject/blob/main/prediction/model.pkl"
click node_app "https://github.com/22amitdeo/dwdmproject/blob/main/prediction/app.py"
click node_predictor "https://github.com/22amitdeo/dwdmproject/blob/main/prediction/predict.py"
click node_evaluator "https://github.com/22amitdeo/dwdmproject/blob/main/prediction/evaluate_model.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_raw,node_cleaner,node_clean,node_warehouse_builder,node_time_dim,node_location_dim,node_crop_dim,node_fact,node_farmer toneBlue
class node_runner,node_mining,node_olap,node_visuals,node_advanced,node_insights,node_price_analysis toneAmber
class node_model_trainer,node_model,node_app,node_predictor,node_evaluator toneMint
class node_mining_results,node_olap_results,node_visual_results,node_advanced_results,node_insight_report toneRose
```

## Components

### Data Preparation

- [Raw Prices](https://github.com/22amitdeo/dwdmproject/blob/main/data/crop_prices.csv): `data/crop_prices.csv`
- [Data Cleaner](https://github.com/22amitdeo/dwdmproject/blob/main/preprocessing/clean_data.py): `preprocessing/clean_data.py`
- [Cleaned Prices](https://github.com/22amitdeo/dwdmproject/blob/main/data/cleaned_crop_prices.csv): `data/cleaned_crop_prices.csv`
- [Warehouse Builder](https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/build_warehouse.py): `warehouse/build_warehouse.py`
- [Time Dimension](https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/time_dimension.csv): `warehouse/time_dimension.csv`
- [Location Dimension](https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/location_dimension.csv): `warehouse/location_dimension.csv`
- [Crop Dimension](https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/crop_dimension.csv): `warehouse/crop_dimension.csv`
- [Price Facts](https://github.com/22amitdeo/dwdmproject/blob/main/warehouse/fact_table.csv): `warehouse/fact_table.csv`

### Risk Analysis

- [Analysis Runner](https://github.com/22amitdeo/dwdmproject/blob/main/run_analysis.py): `run_analysis.py`
- [Risk Mining](https://github.com/22amitdeo/dwdmproject/blob/main/analysis/data_mining.py): `analysis/data_mining.py`
- [OLAP Operations](https://github.com/22amitdeo/dwdmproject/blob/main/analysis/olap_operations.py): `analysis/olap_operations.py`
- [Core Charts](https://github.com/22amitdeo/dwdmproject/blob/main/analysis/visualizations.py): `analysis/visualizations.py`
- [Advanced Charts](https://github.com/22amitdeo/dwdmproject/blob/main/analysis/advanced_visualizations.py): `analysis/advanced_visualizations.py`
- [Insight Generator](https://github.com/22amitdeo/dwdmproject/blob/main/analysis/insights.py): `analysis/insights.py`
- [Price Analysis](https://github.com/22amitdeo/dwdmproject/blob/main/analysis/price_analysis.py): `analysis/price_analysis.py`

### Price Prediction

- [Model Trainer](https://github.com/22amitdeo/dwdmproject/blob/main/prediction/train_model.py): `prediction/train_model.py`
- [Trained Model](https://github.com/22amitdeo/dwdmproject/blob/main/prediction/model.pkl): `prediction/model.pkl`
- [Prediction App](https://github.com/22amitdeo/dwdmproject/blob/main/prediction/app.py): `prediction/app.py`
- [Prediction Function](https://github.com/22amitdeo/dwdmproject/blob/main/prediction/predict.py): `prediction/predict.py`
- [Model Evaluator](https://github.com/22amitdeo/dwdmproject/blob/main/prediction/evaluate_model.py): `prediction/evaluate_model.py`

### Analysis Outputs

- [Mining Results](https://github.com/22amitdeo/dwdmproject/tree/main/results/data_mining): `results/data_mining`
- [OLAP Results](https://github.com/22amitdeo/dwdmproject/tree/main/results/olap): `results/olap`
- [Chart Results](https://github.com/22amitdeo/dwdmproject/tree/main/results/visualizations): `results/visualizations`
- [Advanced Results](https://github.com/22amitdeo/dwdmproject/tree/main/results/advanced_visualizations): `results/advanced_visualizations`
- [Insight Summary](https://github.com/22amitdeo/dwdmproject/blob/main/results/insights_summary.txt): `results/insights_summary.txt`

### Other components

- **App User**

## Connections

- Raw Prices → Data Cleaner: loads (evidence: `preprocessing/clean_data.py`)
- Data Cleaner → Cleaned Prices: writes (evidence: `preprocessing/clean_data.py`)
- Cleaned Prices → Warehouse Builder: reads (evidence: `warehouse/build_warehouse.py`)
- Warehouse Builder → Time Dimension: writes (evidence: `warehouse/build_warehouse.py`)
- Warehouse Builder → Location Dimension: writes (evidence: `warehouse/build_warehouse.py`)
- Warehouse Builder → Crop Dimension: writes (evidence: `warehouse/build_warehouse.py`)
- Warehouse Builder → Price Facts: writes (evidence: `warehouse/build_warehouse.py`)
- Analysis Runner → Risk Mining: runs (evidence: `run_analysis.py`)
- Analysis Runner → OLAP Operations: runs (evidence: `run_analysis.py`)
- Analysis Runner → Core Charts: runs (evidence: `run_analysis.py`)
- Analysis Runner → Advanced Charts: runs (evidence: `run_analysis.py`)
- Analysis Runner → Insight Generator: runs (evidence: `run_analysis.py`)
- Risk Mining → Cleaned Prices: reads (evidence: `analysis/data_mining.py`)
- Risk Mining → Mining Results: writes (evidence: `analysis/data_mining.py`)
- OLAP Operations → Cleaned Prices: reads (evidence: `analysis/olap_operations.py`)
- OLAP Operations → OLAP Results: writes (evidence: `analysis/olap_operations.py`)
- Core Charts → Cleaned Prices: reads (evidence: `analysis/visualizations.py`)
- Core Charts → Chart Results: writes (evidence: `analysis/visualizations.py`)
- Advanced Charts → Cleaned Prices: reads (evidence: `analysis/advanced_visualizations.py`)
- Advanced Charts → Advanced Results: writes (evidence: `analysis/advanced_visualizations.py`)
- Insight Generator → Cleaned Prices: reads (evidence: `analysis/insights.py`)
- Insight Generator → Insight Summary: writes (evidence: `analysis/insights.py`)
- Model Trainer → Cleaned Prices: reads (evidence: `prediction/train_model.py`)
- Model Trainer → Trained Model: saves (evidence: `prediction/train_model.py`)
- App User → Prediction App: enters details (evidence: `prediction/app.py`)
- Prediction App → Cleaned Prices: loads options (evidence: `prediction/app.py`)
- Prediction App → Trained Model: loads (evidence: `prediction/app.py`)
- Prediction Function → Trained Model: loads (evidence: `prediction/predict.py`)
- Model Evaluator → Trained Model: loads (evidence: `prediction/evaluate_model.py`)
- Model Evaluator → Cleaned Prices: reads (evidence: `prediction/evaluate_model.py`)
