# saikiran913/data-engineering-from-zero-to-advanced-lab architecture

> Architecture diagram of the GitHub repository saikiran913/data-engineering-from-zero-to-advanced-lab, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-08). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/saikiran913/data-engineering-from-zero-to-advanced-lab
- Repository: https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab

## Overview

This repository is a day-wise data-engineering learning course, not a single deployed pipeline. The learner progresses through Python setup and programming fundamentals, then data-oriented examples, and finally a small reliability review project. The README documents the learning path and broad course topics; sampled code shows the review app calling parsers, a validator, and a formatter. Many lessons are standalone scripts, so the graph does not imply runtime links between them.

Main entry points: [`README.md`](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/README.md) (Learning path), [`day-060-python-reliability-and-basic-phase-review/mini_project/app.py`](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-060-python-reliability-and-basic-phase-review/mini_project/app.py) (Review app), [`day-050-python-setup-and-virtual-environments/scripts`](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/tree/main/day-050-python-setup-and-virtual-environments/scripts) (Setup), [`day-051-python-variables-and-data-types/scripts`](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/tree/main/day-051-python-variables-and-data-types/scripts) (Types and values)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_course["Course path"]
  node_curriculum["Learning path<br/>[README.md]"]
end

subgraph group_foundations["Python foundations"]
  node_setup["Setup"]
  node_types["Types and values"]
  node_decisions["Validation logic"]
  node_iteration["Loops"]
  node_functions["Reusable functions"]
end

subgraph group_data["Data handling"]
  node_sequences["Sequences"]
  node_lookups["Records and lookups"]
  node_strings["String standardization"]
  node_dates["Freshness checks"]
  node_files["File inspection"]
end

subgraph group_review["Applied review"]
  node_review_app["Review app<br/>[app.py]"]
  node_parsers["CSV and JSON readers<br/>[parsers.py]"]
  node_amount_check["Amount validator<br/>[validators.py]"]
  node_summary["Result formatter<br/>[formatters.py]"]
end

node_learner(("Learner"))

node_learner -->|"follows"| node_curriculum
node_curriculum -->|"starts with"| node_setup
node_curriculum -->|"covers"| node_types
node_curriculum -->|"covers"| node_decisions
node_curriculum -->|"covers"| node_iteration
node_curriculum -->|"covers"| node_functions
node_curriculum -->|"covers"| node_sequences
node_curriculum -->|"covers"| node_lookups
node_curriculum -->|"covers"| node_strings
node_curriculum -->|"covers"| node_dates
node_curriculum -->|"covers"| node_files
node_curriculum -->|"culminates in"| node_review_app
node_review_app -->|"calls"| node_parsers
node_review_app -->|"validates with"| node_amount_check
node_review_app -->|"formats with"| node_summary

click node_curriculum "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/README.md"
click node_setup "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/tree/main/day-050-python-setup-and-virtual-environments/scripts"
click node_types "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/tree/main/day-051-python-variables-and-data-types/scripts"
click node_decisions "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-052-python-conditions-and-boolean-logic/scripts/06_validation_decision_summary.py"
click node_iteration "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-053-python-loops/scripts/06_data_engineering_loop_summary.py"
click node_functions "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-054-python-functions-and-scope/scripts/06_data_engineering_function_workflow.py"
click node_sequences "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-055-python-collections-i/scripts/06_data_engineering_sequence_workflow.py"
click node_lookups "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-056-python-collections-ii/scripts/06_data_engineering_lookup_workflow.py"
click node_strings "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-057-python-strings-for-data-engineers/scripts/06_data_engineering_string_workflow.py"
click node_dates "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-058-python-dates-and-times/scripts/06_data_engineering_freshness_workflow.py"
click node_files "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-059-python-filesystem-basics/scripts/06_data_engineering_filesystem_workflow.py"
click node_review_app "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-060-python-reliability-and-basic-phase-review/mini_project/app.py"
click node_parsers "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/parsers.py"
click node_amount_check "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/validators.py"
click node_summary "https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/formatters.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_curriculum toneBlue
class node_setup,node_types,node_decisions,node_iteration,node_functions toneAmber
class node_sequences,node_lookups,node_strings,node_dates,node_files toneMint
class node_review_app,node_parsers,node_amount_check,node_summary toneRose
class node_learner toneIndigo
```

## Components

### Course path

- [Learning path](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/README.md): `README.md`

### Python foundations

- [Setup](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/tree/main/day-050-python-setup-and-virtual-environments/scripts): `day-050-python-setup-and-virtual-environments/scripts`
- [Types and values](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/tree/main/day-051-python-variables-and-data-types/scripts): `day-051-python-variables-and-data-types/scripts`
- [Validation logic](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-052-python-conditions-and-boolean-logic/scripts/06_validation_decision_summary.py): `day-052-python-conditions-and-boolean-logic/scripts/06_validation_decision_summary.py`
- [Loops](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-053-python-loops/scripts/06_data_engineering_loop_summary.py): `day-053-python-loops/scripts/06_data_engineering_loop_summary.py`
- [Reusable functions](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-054-python-functions-and-scope/scripts/06_data_engineering_function_workflow.py): `day-054-python-functions-and-scope/scripts/06_data_engineering_function_workflow.py`

### Data handling

- [Sequences](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-055-python-collections-i/scripts/06_data_engineering_sequence_workflow.py): `day-055-python-collections-i/scripts/06_data_engineering_sequence_workflow.py`
- [Records and lookups](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-056-python-collections-ii/scripts/06_data_engineering_lookup_workflow.py): `day-056-python-collections-ii/scripts/06_data_engineering_lookup_workflow.py`
- [String standardization](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-057-python-strings-for-data-engineers/scripts/06_data_engineering_string_workflow.py): `day-057-python-strings-for-data-engineers/scripts/06_data_engineering_string_workflow.py`
- [Freshness checks](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-058-python-dates-and-times/scripts/06_data_engineering_freshness_workflow.py): `day-058-python-dates-and-times/scripts/06_data_engineering_freshness_workflow.py`
- [File inspection](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-059-python-filesystem-basics/scripts/06_data_engineering_filesystem_workflow.py): `day-059-python-filesystem-basics/scripts/06_data_engineering_filesystem_workflow.py`

### Applied review

- [Review app](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-060-python-reliability-and-basic-phase-review/mini_project/app.py): `day-060-python-reliability-and-basic-phase-review/mini_project/app.py`
- [CSV and JSON readers](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/parsers.py): `day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/parsers.py`
- [Amount validator](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/validators.py): `day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/validators.py`
- [Result formatter](https://github.com/saikiran913/data-engineering-from-zero-to-advanced-lab/blob/main/day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/formatters.py): `day-060-python-reliability-and-basic-phase-review/mini_project/data_utils/formatters.py`

### Other components

- **Learner**

## Connections

- Learner → Learning path: follows (evidence: `README.md`)
- Learning path → Setup: starts with (evidence: `README.md`)
- Learning path → Types and values: covers (evidence: `README.md`)
- Learning path → Validation logic: covers (evidence: `README.md`)
- Learning path → Loops: covers (evidence: `README.md`)
- Learning path → Reusable functions: covers (evidence: `README.md`)
- Learning path → Sequences: covers (evidence: `README.md`)
- Learning path → Records and lookups: covers (evidence: `README.md`)
- Learning path → String standardization: covers (evidence: `README.md`)
- Learning path → Freshness checks: covers (evidence: `README.md`)
- Learning path → File inspection: covers (evidence: `README.md`)
- Learning path → Review app: culminates in (evidence: `README.md`)
- Review app → CSV and JSON readers: calls (evidence: `day-060-python-reliability-and-basic-phase-review/mini_project/app.py`)
- Review app → Amount validator: validates with (evidence: `day-060-python-reliability-and-basic-phase-review/mini_project/app.py`)
- Review app → Result formatter: formats with (evidence: `day-060-python-reliability-and-basic-phase-review/mini_project/app.py`)
