How pooria12/datatest works
DataMind AI is a browser-based dataset analysis and quality platform. The principal workflow is uploading a CSV/TSV, parsing it, profiling its contents, generating a quality report, and saving the active dataset locally; users can then inspect previews, quality results, and analysis pages. Profiling is a distinct internal layer, with type inference, missing-value and duplicate detection, and statistics feeding the profile. AI insights, cleaning, and authentication are planned rather than implemented. Edges reflect shown calls or documented capabilities; unsampled page internals are not assumed.
Main entry points: router.tsx Page router · DatasetProvider.tsx Dataset state · profilingEngine.ts Profiling engine · datasetRepository.ts Dataset repository
Components 23
Application shell
- App providers
src/app/App.tsx - Page router
src/app/router.tsx
Dataset workflow
- Upload page
src/pages/Upload.tsx - Dataset state
src/context/DatasetProvider.tsx - CSV/TSV parser
src/lib/csv/csvParser.ts - Data preview
src/pages/Preview.tsx - Dataset data model
src/types/dataset.types.ts
Analysis and reports
- Dataset dashboard
src/pages/Dashboard.tsx - Profiling engine
src/lib/profiling/profilingEngine.ts - Type inference
src/lib/profiling/typeInference.ts - Missing values
src/lib/profiling/missingValues.ts - Duplicate detection
src/lib/profiling/duplicates.ts - Column statistics
src/lib/profiling/statistics.ts - Quality scoring
src/lib/profiling/dataQuality.ts - Quality report
src/pages/Quality.tsx - Feature analysis
src/pages/FeatureAnalysis.tsx - AI insights (planned)
src/pages/AIInsights.tsx - Data cleaning (planned)
src/pages/Cleaning.tsx
Local persistence
- Dataset repository
src/lib/storage/datasetRepository.ts - IndexedDB
src/lib/storage/database.ts
Runtime support
- Health endpoint
worker/index.ts
Other components
- Analyst
- Cloudflare runtime
Connections 20
- Analyst → Page router: opens app
README.md - App providers → Page router: provides routes
src/app/App.tsx - Page router → Upload page: routes to
src/app/router.tsx - Page router → Data preview: routes to
src/app/router.tsx - Page router → Dataset dashboard: routes to
src/app/router.tsx - Page router → Quality report: routes to
src/app/router.tsx - Page router → Feature analysis: routes to
src/app/router.tsx - Page router → AI insights (planned): routes to
src/app/router.tsx - Page router → Data cleaning (planned): routes to
src/app/router.tsx - Analyst → Dataset state: submits dataset
README.md - Dataset state → CSV/TSV parser: parses file
src/context/DatasetProvider.tsx - Dataset state → Profiling engine: profiles rows
src/context/DatasetProvider.tsx - Dataset state → Quality scoring: generates report
src/context/DatasetProvider.tsx - Dataset state → Dataset repository: saves dataset
src/context/DatasetProvider.tsx - Profiling engine → Type inference: infers types
src/lib/profiling/profilingEngine.ts - Profiling engine → Missing values: counts missing
src/lib/profiling/profilingEngine.ts - Profiling engine → Duplicate detection: detects duplicates
src/lib/profiling/profilingEngine.ts - Profiling engine → Column statistics: builds statistics
src/lib/profiling/profilingEngine.ts - Dataset repository → IndexedDB: reads and writes
src/lib/storage/datasetRepository.ts - Cloudflare runtime → Health endpoint: serves health API
README.md