# better678/data-quality-analyzer architecture

> Architecture diagram of the GitHub repository better678/data-quality-analyzer, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-04). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/better678/data-quality-analyzer
- Repository: https://github.com/better678/data-quality-analyzer

## Overview

Data Quality Analyzer evaluates uploaded datasets for ML readiness. Users upload a CSV through the Streamlit dashboard or FastAPI endpoint, optionally choose a target, and receive quality findings, a readiness score, and a gate decision; the dashboard also presents visualizations and downloadable reports. Checks cover profiling, schema and statistical issues, duplicates, and target-related risks. The README documents the overall workflow, while excerpts show selected calls; links for unsampled check invocations are therefore documented at the entry-point level rather than inferred from a presumed sequence.

Main entry points: [`app.py`](https://github.com/better678/data-quality-analyzer/blob/main/app.py) (Streamlit Dashboard), [`api/main.py`](https://github.com/better678/data-quality-analyzer/blob/main/api/main.py) (Analysis API), [`report/readiness_score.py`](https://github.com/better678/data-quality-analyzer/blob/main/report/readiness_score.py) (Readiness Scoring), [`pipeline/quality_gate.py`](https://github.com/better678/data-quality-analyzer/blob/main/pipeline/quality_gate.py) (Quality Gate)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_entry["User Interfaces"]
  node_dashboard["Streamlit Dashboard<br/>[app.py]"]
  node_api["Analysis API<br/>[main.py]"]
end

subgraph group_checks["Quality Checks"]
  node_profile["Dataset Profiling<br/>[profiling.py]"]
  node_duplicates["Duplicate Detection<br/>[duplicates.py]"]
  node_types["Type Validation"]
  node_outliers["Outlier Detection"]
  node_correlation["Correlation Analysis<br/>[correlation.py]"]
  node_imbalance["Class Imbalance<br/>[imbalance.py]"]
  node_noise["Label Noise<br/>[label_noise.py]"]
  node_leakage["Leakage Detection<br/>[leakage.py]"]
end

subgraph group_decision["Readiness Decision"]
  node_score["Readiness Scoring<br/>[readiness_score.py]"]
  node_gate["Quality Gate<br/>[quality_gate.py]"]
end

subgraph group_outputs["Results and Reporting"]
  node_visuals["Interactive Visuals<br/>[visualizations.py]"]
  node_report["Report Generation<br/>[generate_report.py]"]
end

node_user(("Dataset User"))

node_user -->|"uploads CSV"| node_dashboard
node_user -->|"uploads CSV"| node_api
node_dashboard -->|"runs checks"| node_profile
node_dashboard -->|"runs checks"| node_duplicates
node_dashboard -->|"runs checks"| node_types
node_dashboard -->|"runs checks"| node_outliers
node_dashboard -->|"runs checks"| node_correlation
node_dashboard -->|"runs checks"| node_imbalance
node_dashboard -->|"runs checks"| node_noise
node_dashboard -->|"runs checks"| node_leakage
node_api -->|"runs checks"| node_profile
node_api -->|"runs checks"| node_duplicates
node_api -->|"runs checks"| node_types
node_api -->|"runs checks"| node_outliers
node_api -->|"runs checks"| node_correlation
node_api -->|"runs checks"| node_imbalance
node_api -->|"runs checks"| node_noise
node_api -->|"runs checks"| node_leakage
node_dashboard -->|"calculates score"| node_score
node_api -->|"calculates score"| node_score
node_dashboard -->|"applies gate"| node_gate
node_api -->|"applies gate"| node_gate
node_dashboard -->|"generates report"| node_report
node_dashboard -->|"renders charts"| node_visuals
node_score -->|"provides score"| node_gate

click node_dashboard "https://github.com/better678/data-quality-analyzer/blob/main/app.py"
click node_api "https://github.com/better678/data-quality-analyzer/blob/main/api/main.py"
click node_profile "https://github.com/better678/data-quality-analyzer/blob/main/checks/profiling.py"
click node_duplicates "https://github.com/better678/data-quality-analyzer/blob/main/checks/duplicates.py"
click node_types "https://github.com/better678/data-quality-analyzer/blob/main/checks/data_type_issues.py"
click node_outliers "https://github.com/better678/data-quality-analyzer/blob/main/checks/outlier_detection.py"
click node_correlation "https://github.com/better678/data-quality-analyzer/blob/main/checks/correlation.py"
click node_imbalance "https://github.com/better678/data-quality-analyzer/blob/main/checks/imbalance.py"
click node_noise "https://github.com/better678/data-quality-analyzer/blob/main/checks/label_noise.py"
click node_leakage "https://github.com/better678/data-quality-analyzer/blob/main/checks/leakage.py"
click node_score "https://github.com/better678/data-quality-analyzer/blob/main/report/readiness_score.py"
click node_gate "https://github.com/better678/data-quality-analyzer/blob/main/pipeline/quality_gate.py"
click node_visuals "https://github.com/better678/data-quality-analyzer/blob/main/report/visualizations.py"
click node_report "https://github.com/better678/data-quality-analyzer/blob/main/report/generate_report.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_dashboard,node_api,node_user toneBlue
class node_profile,node_duplicates,node_types,node_outliers,node_correlation,node_imbalance,node_noise,node_leakage toneAmber
class node_score,node_gate toneMint
class node_visuals,node_report toneRose
```

## Components

### User Interfaces

- [Streamlit Dashboard](https://github.com/better678/data-quality-analyzer/blob/main/app.py): `app.py`
- [Analysis API](https://github.com/better678/data-quality-analyzer/blob/main/api/main.py): `api/main.py`

### Quality Checks

- [Dataset Profiling](https://github.com/better678/data-quality-analyzer/blob/main/checks/profiling.py): `checks/profiling.py`
- [Duplicate Detection](https://github.com/better678/data-quality-analyzer/blob/main/checks/duplicates.py): `checks/duplicates.py`
- [Type Validation](https://github.com/better678/data-quality-analyzer/blob/main/checks/data_type_issues.py): `checks/data_type_issues.py`
- [Outlier Detection](https://github.com/better678/data-quality-analyzer/blob/main/checks/outlier_detection.py): `checks/outlier_detection.py`
- [Correlation Analysis](https://github.com/better678/data-quality-analyzer/blob/main/checks/correlation.py): `checks/correlation.py`
- [Class Imbalance](https://github.com/better678/data-quality-analyzer/blob/main/checks/imbalance.py): `checks/imbalance.py`
- [Label Noise](https://github.com/better678/data-quality-analyzer/blob/main/checks/label_noise.py): `checks/label_noise.py`
- [Leakage Detection](https://github.com/better678/data-quality-analyzer/blob/main/checks/leakage.py): `checks/leakage.py`

### Readiness Decision

- [Readiness Scoring](https://github.com/better678/data-quality-analyzer/blob/main/report/readiness_score.py): `report/readiness_score.py`
- [Quality Gate](https://github.com/better678/data-quality-analyzer/blob/main/pipeline/quality_gate.py): `pipeline/quality_gate.py`

### Results and Reporting

- [Interactive Visuals](https://github.com/better678/data-quality-analyzer/blob/main/report/visualizations.py): `report/visualizations.py`
- [Report Generation](https://github.com/better678/data-quality-analyzer/blob/main/report/generate_report.py): `report/generate_report.py`

### Other components

- **Dataset User**

## Connections

- Dataset User → Streamlit Dashboard: uploads CSV (evidence: `README.md`)
- Dataset User → Analysis API: uploads CSV (evidence: `README.md`)
- Streamlit Dashboard → Dataset Profiling: runs checks (evidence: `app.py`)
- Streamlit Dashboard → Duplicate Detection: runs checks (evidence: `app.py`)
- Streamlit Dashboard → Type Validation: runs checks (evidence: `app.py`)
- Streamlit Dashboard → Outlier Detection: runs checks (evidence: `app.py`)
- Streamlit Dashboard → Correlation Analysis: runs checks (evidence: `app.py`)
- Streamlit Dashboard → Class Imbalance: runs checks (evidence: `app.py`)
- Streamlit Dashboard → Label Noise: runs checks (evidence: `app.py`)
- Streamlit Dashboard → Leakage Detection: runs checks (evidence: `app.py`)
- Analysis API → Dataset Profiling: runs checks (evidence: `api/main.py`)
- Analysis API → Duplicate Detection: runs checks (evidence: `api/main.py`)
- Analysis API → Type Validation: runs checks (evidence: `api/main.py`)
- Analysis API → Outlier Detection: runs checks (evidence: `api/main.py`)
- Analysis API → Correlation Analysis: runs checks (evidence: `api/main.py`)
- Analysis API → Class Imbalance: runs checks (evidence: `api/main.py`)
- Analysis API → Label Noise: runs checks (evidence: `api/main.py`)
- Analysis API → Leakage Detection: runs checks (evidence: `api/main.py`)
- Streamlit Dashboard → Readiness Scoring: calculates score (evidence: `app.py`)
- Analysis API → Readiness Scoring: calculates score (evidence: `api/main.py`)
- Streamlit Dashboard → Quality Gate: applies gate (evidence: `app.py`)
- Analysis API → Quality Gate: applies gate (evidence: `api/main.py`)
- Streamlit Dashboard → Report Generation: generates report (evidence: `app.py`)
- Streamlit Dashboard → Interactive Visuals: renders charts (evidence: `app.py`)
- Readiness Scoring → Quality Gate: provides score (evidence: `pipeline/quality_gate.py`)
