# m-junaid7/retail360-fabric-data-engineering architecture

> Architecture diagram of the GitHub repository m-junaid7/retail360-fabric-data-engineering, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-11). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/m-junaid7/retail360-fabric-data-engineering
- Repository: https://github.com/m-junaid7/retail360-fabric-data-engineering

## Overview

Retail360 is a Microsoft Fabric retail-data engineering project. CSV files are ingested into Bronze Delta tables, validated and cleaned into trusted Silver and quarantine tables, then transformed into Gold dimensions and facts for semantic modeling and Power BI reporting. The README documents sequential pipeline orchestration and the analytics capabilities; the semantic model, pipeline, and report have no implementation files in the tree, so those are represented as external Fabric components.

Main entry points: [`notebooks/02_Silver_Data_Quality .py`](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/02_Silver_Data_Quality%20.py) (Silver quality checks), [`notebooks/03_Gold_Dimensional_Model.py`](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/03_Gold_Dimensional_Model.py) (Gold dimensional model), [`notebooks/01_Bronze_Ingestion.py`](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/01_Bronze_Ingestion.py) (Bronze ingestion)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_ingestion["Bronze ingestion"]
  node_bronze_job["Bronze ingestion"]
  node_bronze_tables[("Bronze Delta tables")]
end

subgraph group_quality["Silver quality"]
  node_silver_job["Silver quality checks"]
  node_silver_tables[("Trusted Silver tables")]
  node_quarantine[("Quarantine tables")]
end

subgraph group_modeling["Gold modeling"]
  node_gold_job["Gold dimensional model"]
  node_dimensions[("Dimensions")]
  node_facts[("Facts")]
end

subgraph group_analytics["Analytics"]
  node_semantic["Fabric semantic model"]
  node_powerbi["Power BI report"]
end

node_csv["Retail CSV files"]
node_pipeline["Fabric pipeline"]

node_csv -->|"reads"| node_bronze_job
node_bronze_job -->|"writes"| node_bronze_tables
node_bronze_tables -->|"reads"| node_silver_job
node_silver_job -->|"writes"| node_silver_tables
node_silver_job -->|"writes"| node_quarantine
node_silver_tables -->|"reads"| node_gold_job
node_gold_job -->|"writes"| node_dimensions
node_gold_job -->|"writes"| node_facts
node_pipeline -->|"runs"| node_bronze_job
node_pipeline -->|"runs"| node_silver_job
node_pipeline -->|"runs"| node_gold_job
node_dimensions -->|"models"| node_semantic
node_facts -->|"models"| node_semantic
node_semantic -->|"feeds"| node_powerbi

click node_bronze_job "https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/01_Bronze_Ingestion.py"
click node_bronze_tables "https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/01_Bronze_Ingestion.py"
click node_silver_job "https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/02_Silver_Data_Quality%20.py"
click node_silver_tables "https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/02_Silver_Data_Quality%20.py"
click node_quarantine "https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/02_Silver_Data_Quality%20.py"
click node_gold_job "https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/03_Gold_Dimensional_Model.py"
click node_dimensions "https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/03_Gold_Dimensional_Model.py"
click node_facts "https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/03_Gold_Dimensional_Model.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_bronze_job,node_bronze_tables toneBlue
class node_silver_job,node_silver_tables,node_quarantine toneAmber
class node_gold_job,node_dimensions,node_facts toneMint
class node_semantic,node_powerbi toneRose
class node_csv,node_pipeline toneIndigo
```

## Components

### Bronze ingestion

- [Bronze ingestion](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/01_Bronze_Ingestion.py): `notebooks/01_Bronze_Ingestion.py`
- [Bronze Delta tables](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/01_Bronze_Ingestion.py): `notebooks/01_Bronze_Ingestion.py`

### Silver quality

- [Silver quality checks](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/02_Silver_Data_Quality%20.py): `notebooks/02_Silver_Data_Quality .py`
- [Trusted Silver tables](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/02_Silver_Data_Quality%20.py): `notebooks/02_Silver_Data_Quality .py`
- [Quarantine tables](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/02_Silver_Data_Quality%20.py): `notebooks/02_Silver_Data_Quality .py`

### Gold modeling

- [Gold dimensional model](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/03_Gold_Dimensional_Model.py): `notebooks/03_Gold_Dimensional_Model.py`
- [Dimensions](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/03_Gold_Dimensional_Model.py): `notebooks/03_Gold_Dimensional_Model.py`
- [Facts](https://github.com/m-junaid7/retail360-fabric-data-engineering/blob/main/notebooks/03_Gold_Dimensional_Model.py): `notebooks/03_Gold_Dimensional_Model.py`

### Analytics

- **Fabric semantic model**
- **Power BI report**

### Other components

- **Retail CSV files**
- **Fabric pipeline**

## Connections

- Retail CSV files → Bronze ingestion: reads (evidence: `notebooks/01_Bronze_Ingestion.py`)
- Bronze ingestion → Bronze Delta tables: writes (evidence: `notebooks/01_Bronze_Ingestion.py`)
- Bronze Delta tables → Silver quality checks: reads (evidence: `notebooks/02_Silver_Data_Quality .py`)
- Silver quality checks → Trusted Silver tables: writes (evidence: `notebooks/02_Silver_Data_Quality .py`)
- Silver quality checks → Quarantine tables: writes (evidence: `notebooks/02_Silver_Data_Quality .py`)
- Trusted Silver tables → Gold dimensional model: reads (evidence: `notebooks/03_Gold_Dimensional_Model.py`)
- Gold dimensional model → Dimensions: writes (evidence: `notebooks/03_Gold_Dimensional_Model.py`)
- Gold dimensional model → Facts: writes (evidence: `notebooks/03_Gold_Dimensional_Model.py`)
- Fabric pipeline → Bronze ingestion: runs (evidence: `README.md`)
- Fabric pipeline → Silver quality checks: runs (evidence: `README.md`)
- Fabric pipeline → Gold dimensional model: runs (evidence: `README.md`)
- Dimensions → Fabric semantic model: models (evidence: `README.md`)
- Facts → Fabric semantic model: models (evidence: `README.md`)
- Fabric semantic model → Power BI report: feeds (evidence: `README.md`)