How saikiran913/data-engineering-from-zero-to-advanced-lab works
This repository is a day-wise data-engineering learning course, not a single deployed pipeline. The learner progresses through Python setup and programming fundamentals, then data-oriented examples, and finally a small reliability review project. The README documents the learning path and broad course topics; sampled code shows the review app calling parsers, a validator, and a formatter. Many lessons are standalone scripts, so the graph does not imply runtime links between them.
Main entry points: README.md Learning path · app.py Review app · day-050-python-setup-and-virtual-environments/scripts Setup · day-051-python-variables-and-data-types/scripts Types and values
Components 16
Course path
- Learning path
README.md
Python foundations
- Setup
day-050-python-setup-and-virtual-environments/scripts - Types and values
day-051-python-variables-and-data-types/scripts - Validation logic
day-052-python-conditions-and-boolean-logic/scripts/06_validation_decision_summary.py - Loops
day-053-python-loops/scripts/06_data_engineering_loop_summary.py - Reusable functions
day-054-python-functions-and-scope/scripts/06_data_engineering_function_workflow.py
Data handling
- Sequences
day-055-python-collections-i/scripts/06_data_engineering_sequence_workflow.py - Records and lookups
day-056-python-collections-ii/scripts/06_data_engineering_lookup_workflow.py - String standardization
day-057-python-strings-for-data-engineers/scripts/06_data_engineering_string_workflow.py - Freshness checks
day-058-python-dates-and-times/scripts/06_data_engineering_freshness_workflow.py - File inspection
day-059-python-filesystem-basics/scripts/06_data_engineering_filesystem_workflow.py
Applied review
- Review app
day-060-python-reliability-and-basic-phase-review/mini_project/app.py - CSV and JSON readers
day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/parsers.py - Amount validator
day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/validators.py - Result formatter
day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/formatters.py
Other components
- Learner
Connections 15
- Learner → Learning path: follows
README.md - Learning path → Setup: starts with
README.md - Learning path → Types and values: covers
README.md - Learning path → Validation logic: covers
README.md - Learning path → Loops: covers
README.md - Learning path → Reusable functions: covers
README.md - Learning path → Sequences: covers
README.md - Learning path → Records and lookups: covers
README.md - Learning path → String standardization: covers
README.md - Learning path → Freshness checks: covers
README.md - Learning path → File inspection: covers
README.md - Learning path → Review app: culminates in
README.md - Review app → CSV and JSON readers: calls
day-060-python-reliability-and-basic-phase-review/mini_project/app.py - Review app → Amount validator: validates with
day-060-python-reliability-and-basic-phase-review/mini_project/app.py - Review app → Result formatter: formats with
day-060-python-reliability-and-basic-phase-review/mini_project/app.py