How xitizkadwe/autoschema-etl-works---project works
AutoSchema ETL is a local CSV/XLS data-quality workspace. A user uploads a file through the React app; the API processes and persists normalized accepted and quarantined rows, then returns metrics and rows for review, filtering, numeric summaries, and CSV export. Users can revisit recent batches, download a synthetic sample, or optionally request Gemini advice based only on column names and aggregate metrics. Core paths and calls are supported by the excerpts and README; database internals and sample generation were not sampled.
Main entry points: App.jsx Workspace · main.py Dataset API · api.js API client · NumericSummary.jsx Numeric summary
Components 17
Workspace UI
- Workspace
frontend/src/App.jsx - API client
frontend/src/api.js - Upload control
frontend/src/components/UploadZone.jsx - Pipeline metrics
frontend/src/components/PipelineMetrics.jsx - Data filters
frontend/src/components/DataFilters.jsx - Quarantine review
frontend/src/components/QuarantineTable.jsx - Numeric summary
frontend/src/components/NumericSummary.jsx - Advice report
frontend/src/components/AdvisorResponse.jsx
ETL processing
- File normalization
backend/app/etl_engine.py - Sample generator
backend/app/sample_generator.py
API and persistence
- Dataset API
backend/app/main.py - Batch models
backend/app/models.py - SQLite persistence
backend/app/database.py
Analysis and advice
- Row analysis
frontend/src/dataAnalysis.js - Gemini advisor
backend/app/ai_advisor.py
Other components
- User
- Gemini service
Connections 18
- User → Workspace: uses
README.md - Workspace → Upload control: renders
frontend/src/App.jsx - Workspace → API client: calls
frontend/src/App.jsx - Workspace → Pipeline metrics: renders
frontend/src/App.jsx - Workspace → Data filters: renders
frontend/src/App.jsx - Workspace → Quarantine review: renders
frontend/src/App.jsx - Workspace → Numeric summary: renders
frontend/src/App.jsx - Workspace → Advice report: renders
frontend/src/App.jsx - Workspace → Row analysis: uses
frontend/src/App.jsx - Numeric summary → Row analysis: calculates with
frontend/src/components/NumericSummary.jsx - API client → Dataset API: requests
frontend/src/api.js - Dataset API → File normalization: processes upload
backend/app/main.py - Dataset API → SQLite persistence: reads and writes
backend/app/main.py - Batch models → SQLite persistence: uses base
backend/app/models.py - Dataset API → Batch models: returns batch schemas
backend/app/main.py - Dataset API → Sample generator: generates sample
backend/app/main.py - Dataset API → Gemini advisor: requests advice
backend/app/main.py - Gemini advisor → Gemini service: requests recommendations
backend/app/ai_advisor.py