How barnalimohapatra/docker-workshop works
This small repository contains independent Python examples rather than a documented, connected application. pipeline/ingest_data.py downloads January 2021 NYC yellow-taxi data in chunks and writes it to PostgreSQL; pipeline/pipeline.py reads a day argument and writes a small example DataFrame to Parquet. pipeline/main.py is a standalone greeting entry point. The README provides no further product capabilities or wiring, so no links between these scripts are inferred.
Main entry points: ingest_data.py Taxi Ingestion · pipeline.py Parquet Example
Components 6
Other components
- Taxi Ingestion
pipeline/ingest_data.py - Taxi CSV
- PostgreSQL
- Parquet Example
pipeline/pipeline.py - Parquet Output
- Greeting Entry
pipeline/main.py
Connections 3
- Taxi Ingestion → Taxi CSV: downloads CSV
pipeline/ingest_data.py - Taxi Ingestion → PostgreSQL: writes chunks
pipeline/ingest_data.py - Parquet Example → Parquet Output: writes Parquet
pipeline/pipeline.py