How br3nnk/etl works
This repository is an early ETL project: its standalone script fetches user and product records from a public API and saves each record as JSON. The src/etl package contains paginated extraction, field transformations, settings, and SQLAlchemy models, but its main.py and load.py are empty, so the sampled code does not connect those pieces into a database-loading workflow. The graph distinguishes the working script from these package capabilities; edges reflect only visible calls or requests.
Main entry points: ETL.py Endpoint Loop · extract.py Paginated Extractor
Components 12
Standalone ETL
- Endpoint Loop
ETL.py - API Extraction
ETL.py - JSON File Loader
ETL.py - JSON Files
ETL Package
- Settings
src/etl/config.py - Paginated Extractor
src/etl/extract.py - User Transform
src/etl/transform.py - Product Transform
src/etl/transform.py - Load Module
src/etl/load.py - Package Entry
src/etl/main.py
Data Schema
- ORM Models
src/etl/models.py
Other components
- DummyJSON API
Connections 5
- Endpoint Loop → API Extraction: calls
ETL.py - Endpoint Loop → JSON File Loader: calls
ETL.py - API Extraction → DummyJSON API: requests
ETL.py - JSON File Loader → JSON Files: writes
ETL.py - Paginated Extractor → DummyJSON API: requests
src/etl/extract.py