How naveenofficial916-tech/zomato_restaurant_data_analytics works
This repository is a Zomato analytics and engineering project: it generates synthetic platform data, provides a Medallion Lakehouse pipeline, and exposes operational, commercial, and customer analytics through several tools. The documented workflow runs data generation and quality checks before analysis; the separate Spark pipeline transforms raw data through Bronze, Silver, and Gold. Excel consumes Gold exports, while the browser dashboard loads its JSON data directly. The graph also preserves the documented SQL, Power BI, ML, geospatial, and pricing capabilities. Some subsystem links are documented rather than source-verified.
Main entry points: raw Raw datasets · run_project.py Project runner · 03_gold_aggregation.py Gold data marts · app.js Interactive dashboard
Components 21
Data foundation
- Synthetic data generator
python_data_gen/generate_zomato_data.py - Raw datasets
data/raw - Data quality audit
data_quality/data_validation_suite.py
Lakehouse pipeline
- Bronze ingestion
pyspark_delta/01_bronze_ingestion.py - Silver enrichment
pyspark_delta/02_silver_transformation.py - Gold data marts
pyspark_delta/03_gold_aggregation.py - Databricks pipeline
pyspark_delta/databricks_notebook_pipeline.py
Analytics engines
- SQL analytics
sql_analytics - Delivery prediction
ml_models/predict_delivery_time.py - Restaurant recommender
ml_models/restaurant_recommender.py - Surge simulation
pricing_engine/surge_pricing_simulator.py
Reporting surfaces
- Executive workbook
excel_reports/build_excel_dashboard.py - Power BI model
power_bi/power_bi_data_model.md - DAX measures
power_bi/dax_measures.dax - Dashboard data
web_dashboard/data.json - Interactive dashboard
web_dashboard/app.js - Dashboard page
web_dashboard/index.html
Operational insights
- Kitchen opportunity finder
geo_analytics/cloud_kitchen_finder.py - Project runner
run_project.py
Other components
- Project user
- OpenStreetMap tiles
Connections 27
- Project user → Project runner: runs workflow
run_project.py - Project runner → Synthetic data generator: runs
run_project.py - Synthetic data generator → Raw datasets: writes datasets
python_data_gen/generate_zomato_data.py - Project runner → Data quality audit: runs audit
run_project.py - Data quality audit → Raw datasets: validates
data_quality/data_validation_suite.py - Raw datasets → Bronze ingestion: ingested as
pyspark_delta/01_bronze_ingestion.py - Bronze ingestion → Silver enrichment: cleaned into
README.md - Silver enrichment → Gold data marts: aggregated into
README.md - Raw datasets → Databricks pipeline: reads raw data
pyspark_delta/databricks_notebook_pipeline.py - Databricks pipeline → Gold data marts: materializes marts
pyspark_delta/databricks_notebook_pipeline.py - Raw datasets → SQL analytics: analyzed in
README.md - Raw datasets → Delivery prediction: trains from
ml_models/predict_delivery_time.py - Raw datasets → Restaurant recommender: scores from
ml_models/restaurant_recommender.py - Raw datasets → Surge simulation: simulates from
pricing_engine/surge_pricing_simulator.py - Raw datasets → Kitchen opportunity finder: finds demand from
geo_analytics/cloud_kitchen_finder.py - Gold data marts → Executive workbook: loads summaries
excel_reports/build_excel_dashboard.py - Gold data marts → Power BI model: modeled for
README.md - Power BI model → DAX measures: uses measures
README.md - Project user → Dashboard page: opens dashboard
README.md - Dashboard page → Interactive dashboard: loads script
- Interactive dashboard → Dashboard data: fetches JSON
web_dashboard/app.js - Interactive dashboard → OpenStreetMap tiles: loads map tiles
web_dashboard/app.js - Project runner → Delivery prediction: runs
run_project.py - Project runner → Restaurant recommender: runs
run_project.py - Project runner → Kitchen opportunity finder: runs
run_project.py - Project runner → Surge simulation: runs
run_project.py - Project runner → Executive workbook: builds
run_project.py