# kunaly0/credit_risk_projects architecture

> Architecture diagram of the GitHub repository kunaly0/credit_risk_projects, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-06). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/kunaly0/credit_risk_projects
- Repository: https://github.com/kunaly0/credit_risk_projects

## Overview

This repository builds a traceable credit-risk data foundation: Freddie Mac loan files and FRED macroeconomic series are transformed and loaded into PostgreSQL, where quality checks and audit records support downstream reporting. The graph includes the documented schema, SQL quality rules, summary views, and Power BI dashboard. Source excerpts confirm the loader, quality-suite, macro-loader, and checksum behavior; other subsystem links are included only where the README documents them.

Main entry points: [`src/macro/load_fred.py`](https://github.com/kunaly0/credit_risk_projects/blob/main/src/macro/load_fred.py) (Macro loader), [`src/etl/loader.py`](https://github.com/kunaly0/credit_risk_projects/blob/main/src/etl/loader.py) (Loan ETL loader), [`src/dq/run_dq_suite.py`](https://github.com/kunaly0/credit_risk_projects/blob/main/src/dq/run_dq_suite.py) (DQ suite runner), [`scripts/verify_raw_checksums.py`](https://github.com/kunaly0/credit_risk_projects/blob/main/scripts/verify_raw_checksums.py) (Checksum verifier)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_ingest["Loan ingestion"]
  node_sample_runner["Sample load runner<br/>[load_sample.py]"]
  node_loan_loader["Loan ETL loader<br/>[loader.py]"]
  node_transforms["Loan transforms<br/>[transforms.py]"]
  node_schema["Star schema setup"]
end

subgraph group_macro["Macro data"]
  node_macro_loader["Macro loader<br/>[load_fred.py]"]
  node_macro_config["Macro settings<br/>[macro_config.yaml]"]
end

subgraph group_quality["Quality and governance"]
  node_dq_runner["DQ suite runner<br/>[run_dq_suite.py]"]
  node_dq_sql["DQ rule queries"]
  node_checksum["Checksum verifier"]
  node_provenance["Source checksums"]
end

subgraph group_reporting["Reporting"]
  node_views["Dashboard views"]
  node_powerbi["Power BI dashboard<br/>[project0_dq.pbix]"]
end

node_freddie["Freddie Mac files"]
node_postgres[("PostgreSQL")]
node_fred(("FRED API"))
node_report_user(("Report user"))

node_freddie -->|"provides files"| node_sample_runner
node_sample_runner -->|"dispatches loads"| node_loan_loader
node_loan_loader -->|"uses transforms"| node_transforms
node_loan_loader -->|"loads loan rows"| node_postgres
node_loan_loader -->|"records load audit"| node_postgres
node_schema -->|"creates schema"| node_postgres
node_fred -->|"provides series"| node_macro_loader
node_macro_config -->|"configures series"| node_macro_loader
node_macro_loader -->|"reads loan states"| node_postgres
node_macro_loader -->|"replaces macro tables"| node_postgres
node_macro_loader -->|"downloads series"| node_fred
node_dq_runner -->|"queries data"| node_postgres
node_dq_runner -->|"writes DQ results"| node_postgres
node_dq_runner -.->|"implements checks"| node_dq_sql
node_checksum -->|"reads records"| node_provenance
node_checksum -.->|"checks saved pulls"| node_fred
node_views -->|"queries summaries"| node_postgres
node_powerbi -->|"uses views"| node_views
node_report_user -.->|"views dashboard"| node_powerbi

click node_sample_runner "https://github.com/kunaly0/credit_risk_projects/blob/main/scripts/load_sample.py"
click node_loan_loader "https://github.com/kunaly0/credit_risk_projects/blob/main/src/etl/loader.py"
click node_transforms "https://github.com/kunaly0/credit_risk_projects/blob/main/src/etl/transforms.py"
click node_schema "https://github.com/kunaly0/credit_risk_projects/blob/main/sql/01_create_dimensions.sql"
click node_macro_loader "https://github.com/kunaly0/credit_risk_projects/blob/main/src/macro/load_fred.py"
click node_macro_config "https://github.com/kunaly0/credit_risk_projects/blob/main/config/macro_config.yaml"
click node_dq_runner "https://github.com/kunaly0/credit_risk_projects/blob/main/src/dq/run_dq_suite.py"
click node_dq_sql "https://github.com/kunaly0/credit_risk_projects/tree/main/sql/dq"
click node_checksum "https://github.com/kunaly0/credit_risk_projects/blob/main/scripts/verify_raw_checksums.py"
click node_provenance "https://github.com/kunaly0/credit_risk_projects/tree/main/docs/provenance"
click node_views "https://github.com/kunaly0/credit_risk_projects/blob/main/sql/12_create_dashboard_views.sql"
click node_powerbi "https://github.com/kunaly0/credit_risk_projects/blob/main/dashboards/project0_dq.pbix"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_sample_runner,node_loan_loader,node_transforms,node_schema,node_report_user toneBlue
class node_macro_loader,node_macro_config,node_postgres toneAmber
class node_dq_runner,node_dq_sql,node_checksum,node_provenance,node_fred toneMint
class node_views,node_powerbi toneRose
class node_freddie toneIndigo
```

## Components

### Loan ingestion

- [Sample load runner](https://github.com/kunaly0/credit_risk_projects/blob/main/scripts/load_sample.py): `scripts/load_sample.py`
- [Loan ETL loader](https://github.com/kunaly0/credit_risk_projects/blob/main/src/etl/loader.py): `src/etl/loader.py`
- [Loan transforms](https://github.com/kunaly0/credit_risk_projects/blob/main/src/etl/transforms.py): `src/etl/transforms.py`
- [Star schema setup](https://github.com/kunaly0/credit_risk_projects/blob/main/sql/01_create_dimensions.sql): `sql/01_create_dimensions.sql`

### Macro data

- [Macro loader](https://github.com/kunaly0/credit_risk_projects/blob/main/src/macro/load_fred.py): `src/macro/load_fred.py`
- [Macro settings](https://github.com/kunaly0/credit_risk_projects/blob/main/config/macro_config.yaml): `config/macro_config.yaml`

### Quality and governance

- [DQ suite runner](https://github.com/kunaly0/credit_risk_projects/blob/main/src/dq/run_dq_suite.py): `src/dq/run_dq_suite.py`
- [DQ rule queries](https://github.com/kunaly0/credit_risk_projects/tree/main/sql/dq): `sql/dq`
- [Checksum verifier](https://github.com/kunaly0/credit_risk_projects/blob/main/scripts/verify_raw_checksums.py): `scripts/verify_raw_checksums.py`
- [Source checksums](https://github.com/kunaly0/credit_risk_projects/tree/main/docs/provenance): `docs/provenance`

### Reporting

- [Dashboard views](https://github.com/kunaly0/credit_risk_projects/blob/main/sql/12_create_dashboard_views.sql): `sql/12_create_dashboard_views.sql`
- [Power BI dashboard](https://github.com/kunaly0/credit_risk_projects/blob/main/dashboards/project0_dq.pbix): `dashboards/project0_dq.pbix`

### Other components

- **Freddie Mac files**
- **PostgreSQL**
- **FRED API**
- **Report user**

## Connections

- Freddie Mac files → Sample load runner: provides files (evidence: `README.md`)
- Sample load runner → Loan ETL loader: dispatches loads (evidence: `scripts/load_sample.py`)
- Loan ETL loader → Loan transforms: uses transforms (evidence: `src/etl/loader.py`)
- Loan ETL loader → PostgreSQL: loads loan rows (evidence: `src/etl/loader.py`)
- Loan ETL loader → PostgreSQL: records load audit (evidence: `src/etl/loader.py`)
- Star schema setup → PostgreSQL: creates schema (evidence: `README.md`)
- FRED API → Macro loader: provides series (evidence: `README.md`)
- Macro settings → Macro loader: configures series (evidence: `src/macro/load_fred.py`)
- Macro loader → PostgreSQL: reads loan states (evidence: `src/macro/load_fred.py`)
- Macro loader → PostgreSQL: replaces macro tables (evidence: `src/macro/load_fred.py`)
- Macro loader → FRED API: downloads series (evidence: `src/macro/load_fred.py`)
- DQ suite runner → PostgreSQL: queries data (evidence: `src/dq/run_dq_suite.py`)
- DQ suite runner → PostgreSQL: writes DQ results (evidence: `src/dq/run_dq_suite.py`)
- DQ suite runner → DQ rule queries: implements checks (evidence: `README.md`)
- Checksum verifier → Source checksums: reads records (evidence: `scripts/verify_raw_checksums.py`)
- Checksum verifier → FRED API: checks saved pulls (evidence: `scripts/verify_raw_checksums.py`)
- Dashboard views → PostgreSQL: queries summaries (evidence: `README.md`)
- Power BI dashboard → Dashboard views: uses views (evidence: `README.md`)
- Report user → Power BI dashboard: views dashboard
