How jaypatel1511/cdfi-data works
cdfi-data is a Python ETL library for preparing CDFI Fund Transaction Level Report (TLR), Consumer Loan Report (CLR), and Awards data for analysis. A user calls a dataset loader; TLR can download and extract cached annual releases, while CLR and Awards accept local CSV files. Loaders standardize records, expose dataset-specific filtering and summaries, and export results. The TLR loader also stacks annual releases with provenance. Source excerpts establish the main calls; unsampled modules and finer-grained runtime behavior are not inferred.
Main entry points: tlr.py TLR loader · clr.py CLR loader · awards.py Awards loader · schema.py Dataset schemas
Components 12
Dataset loaders
- Public API
cdfidata/__init__.py - TLR loader
cdfidata/sources/tlr.py - CLR loader
cdfidata/sources/clr.py - Awards loader
cdfidata/sources/awards.py
Data acquisition
- Download and extract
cdfidata/pipeline/downloader.py - CDFI Fund releases
- Local cache
Standardization
- Data standardizer
cdfidata/pipeline/cleaner.py - Dataset schemas
cdfidata/utils/schema.py
Analysis and export
- Data exporter
cdfidata/pipeline/exporter.py - Analysis results
Other components
- Python user
Connections 22
- Python user → Public API: imports
README.md - Public API → TLR loader: exposes
cdfidata/__init__.py - Public API → CLR loader: exposes
cdfidata/__init__.py - Public API → Awards loader: exposes
cdfidata/__init__.py - Python user → TLR loader: loads and analyzes
README.md - Python user → CLR loader: loads and analyzes
README.md - Python user → Awards loader: loads and analyzes
README.md - TLR loader → Download and extract: downloads releases
cdfidata/sources/tlr.py - Download and extract → CDFI Fund releases: requests data
cdfidata/pipeline/downloader.py - Download and extract → Local cache: reads and writes
cdfidata/pipeline/downloader.py - TLR loader → Data standardizer: standardizes rows
cdfidata/sources/tlr.py - CLR loader → Data standardizer: standardizes rows
cdfidata/sources/clr.py - Awards loader → Data standardizer: standardizes rows
cdfidata/sources/awards.py - Data standardizer → Dataset schemas: uses value rules
cdfidata/pipeline/cleaner.py - Download and extract → Dataset schemas: uses release URLs
cdfidata/pipeline/downloader.py - TLR loader → Dataset schemas: uses TLR definitions
cdfidata/sources/tlr.py - CLR loader → Dataset schemas: uses CLR definitions
cdfidata/sources/clr.py - Awards loader → Dataset schemas: uses award definitions
cdfidata/sources/awards.py - TLR loader → Data exporter: exports frames
cdfidata/sources/tlr.py - CLR loader → Data exporter: exports frames
cdfidata/sources/clr.py - Awards loader → Data exporter: exports frames
cdfidata/sources/awards.py - Data exporter → Analysis results: writes files
cdfidata/pipeline/exporter.py