How meyyappan-al/student_budget_analytics works
Student Budget Analytics cleans survey data, derives financial measures, validates and loads the result into PostgreSQL, then exposes checked analytics through a deterministic plain-English assistant. The main workflow is documented in the README; source excerpts additionally confirm pipeline orchestration, quality verification and database-loading responsibilities. Assistant capabilities are implemented in one script, so several nodes share its path. Relationships for unsampled schema and analytics-view definitions are shown only where the README documents them.
Main entry points: pipeline.py Pipeline runner · assistant.py Question parser · transformed_student_budget.csv Analysis dataset · data_loader.py CSV loader
Components 23
Data preparation
- Survey cleaning
src/cleaner.py - Cleaned dataset
Data/processed/cleaned_student_budget.csv - Metric transformation
src/transformer.py - Analysis dataset
Data/processed/transformed_student_budget.csv
Quality and storage
- Pipeline runner
src/pipeline.py - Quality checks
src/data_quality.py - CSV loader
src/data_loader.py - Database access
src/database.py - Table schema
sql/schema.sql
Assistant analytics
- Analytics view
sql/analytics.sql - Question parser
ai/assistant.py - SQL safety guard
ai/assistant.py - Query execution
ai/assistant.py - CSV query engine
ai/assistant.py - Dataset insights
ai/assistant.py - Failure and quality explanations
ai/assistant.py
User interfaces
- Assistant commands
ai/assistant.py - Interactive chat
ai/assistant.py - HTTP interface
ai/assistant.py
Other components
- Analyst
- Survey workbook
Data/Student Budget Analytics Raw Data.xlsx - PostgreSQL
- Answer
Connections 35
- Pipeline runner → Survey cleaning: runs cleaning
README.md - Survey workbook → Survey cleaning: reads workbook
README.md - Survey cleaning → Cleaned dataset: writes CSV
README.md - Pipeline runner → Metric transformation: runs transformation
README.md - Cleaned dataset → Metric transformation: reads cleaned data
README.md - Metric transformation → Analysis dataset: writes metrics
README.md - Pipeline runner → Quality checks: runs quality gate
src/pipeline.py - Quality checks → Analysis dataset: checks dataset
README.md - Pipeline runner → CSV loader: runs load stage
src/pipeline.py - CSV loader → Analysis dataset: loads CSV
README.md - Pipeline runner → Database access: applies schema
src/pipeline.py - Database access → Table schema: executes DDL
README.md - CSV loader → PostgreSQL: bulk loads
README.md - Table schema → PostgreSQL: defines table
README.md - Analytics view → PostgreSQL: defines view
README.md - Analyst → Assistant commands: asks question
README.md - Analyst → Interactive chat: starts session
README.md - Analyst → HTTP interface: sends request
README.md - Assistant commands → Question parser: parses question
README.md - Interactive chat → Question parser: parses question
README.md - HTTP interface → Question parser: routes question
README.md - Question parser → SQL safety guard: validates SQL
README.md - SQL safety guard → Query execution: permits query
README.md - Query execution → Analytics view: queries view
README.md - Query execution → PostgreSQL: executes SELECT
README.md - Question parser → CSV query engine: selects offline mode
README.md - CSV query engine → Analysis dataset: reads CSV
README.md - Assistant commands → Dataset insights: requests insights
README.md - Assistant commands → Failure and quality explanations: explains findings
README.md - Analyst → Failure and quality explanations: submits log or report
- Query execution → Answer: returns results
- CSV query engine → Answer: returns results
- Dataset insights → Answer: reports overview
- Failure and quality explanations → Answer: explains findings
- Answer → Analyst: presents answer