How better678/data-quality-analyzer works
Data Quality Analyzer evaluates uploaded datasets for ML readiness. Users upload a CSV through the Streamlit dashboard or FastAPI endpoint, optionally choose a target, and receive quality findings, a readiness score, and a gate decision; the dashboard also presents visualizations and downloadable reports. Checks cover profiling, schema and statistical issues, duplicates, and target-related risks. The README documents the overall workflow, while excerpts show selected calls; links for unsampled check invocations are therefore documented at the entry-point level rather than inferred from a presumed sequence.
Main entry points: app.py Streamlit Dashboard · main.py Analysis API · readiness_score.py Readiness Scoring · quality_gate.py Quality Gate
Components 15
User Interfaces
- Streamlit Dashboard
app.py - Analysis API
api/main.py
Quality Checks
- Dataset Profiling
checks/profiling.py - Duplicate Detection
checks/duplicates.py - Type Validation
checks/data_type_issues.py - Outlier Detection
checks/outlier_detection.py - Correlation Analysis
checks/correlation.py - Class Imbalance
checks/imbalance.py - Label Noise
checks/label_noise.py - Leakage Detection
checks/leakage.py
Readiness Decision
- Readiness Scoring
report/readiness_score.py - Quality Gate
pipeline/quality_gate.py
Results and Reporting
- Interactive Visuals
report/visualizations.py - Report Generation
report/generate_report.py
Other components
- Dataset User
Connections 25
- Dataset User → Streamlit Dashboard: uploads CSV
README.md - Dataset User → Analysis API: uploads CSV
README.md - Streamlit Dashboard → Dataset Profiling: runs checks
app.py - Streamlit Dashboard → Duplicate Detection: runs checks
app.py - Streamlit Dashboard → Type Validation: runs checks
app.py - Streamlit Dashboard → Outlier Detection: runs checks
app.py - Streamlit Dashboard → Correlation Analysis: runs checks
app.py - Streamlit Dashboard → Class Imbalance: runs checks
app.py - Streamlit Dashboard → Label Noise: runs checks
app.py - Streamlit Dashboard → Leakage Detection: runs checks
app.py - Analysis API → Dataset Profiling: runs checks
api/main.py - Analysis API → Duplicate Detection: runs checks
api/main.py - Analysis API → Type Validation: runs checks
api/main.py - Analysis API → Outlier Detection: runs checks
api/main.py - Analysis API → Correlation Analysis: runs checks
api/main.py - Analysis API → Class Imbalance: runs checks
api/main.py - Analysis API → Label Noise: runs checks
api/main.py - Analysis API → Leakage Detection: runs checks
api/main.py - Streamlit Dashboard → Readiness Scoring: calculates score
app.py - Analysis API → Readiness Scoring: calculates score
api/main.py - Streamlit Dashboard → Quality Gate: applies gate
app.py - Analysis API → Quality Gate: applies gate
api/main.py - Streamlit Dashboard → Report Generation: generates report
app.py - Streamlit Dashboard → Interactive Visuals: renders charts
app.py - Readiness Scoring → Quality Gate: provides score
pipeline/quality_gate.py