How wilfredjeeva/snowflake-dbt works
This repository is a dbt/Snowflake data-refinery project: it defines tiered data models, governance macros and Snowflake policy SQL, plus metadata-validation and dbt-test-report scripts. The apparent data workflow runs from bronze ingestion through silver snapshots and gold/platinum models; the tree supports these stages, but the SQL model definitions were not excerpted, so their runtime links are shown as unverified. The excerpts do support the validator’s scan of model YAML and the report script’s use of dbt result and manifest files.
Main entry points: silver/airbnb Silver snapshots · bronze_adf Bronze models · gold/airbnb Gold models · dbt_report.py Test report
Components 13
Data models
- Bronze models
datahub_refinery/models/bronze_adf - Silver snapshots
datahub_refinery/snapshots/silver/airbnb - Gold models
datahub_refinery/models/gold/airbnb - Platinum model
datahub_refinery/models/platinum/ai_planningorizons
Governance
- Model metadata
datahub_refinery/models - Governance macros
datahub_refinery/macros/governance - SCD macros
datahub_refinery/macros/snapshots - Snowflake policies
snowflake_sql/elt_policies
Reporting tools
- Metadata validator
scripts/validate_metadata.py - Test report
scripts/dbt_report.py
Other components
- Source systems
- dbt run artifacts
- HTML report
Connections 9
- Source systems → Bronze models: ingests
- Bronze models → Silver snapshots: transforms
- Silver snapshots → Gold models: transforms
- Gold models → Platinum model: transforms
- Metadata validator → Model metadata: scans YAML
scripts/validate_metadata.py - Governance macros → Snowflake policies: supports policies
- SCD macros → Silver snapshots: supports snapshots
- dbt run artifacts → Test report: reads results
scripts/dbt_report.py - Test report → HTML report: writes HTML
scripts/dbt_report.py