# anshlambagit/airbnb_snowflake_dbt_data_engineer_project architecture

> Architecture diagram of the GitHub repository anshlambagit/airbnb_snowflake_dbt_data_engineer_project, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project
- Repository: https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project

## Overview

This is a dbt/Snowflake Airbnb analytics pipeline: CSV data is loaded to staging, transformed through Bronze and Silver into Gold analytics models, with snapshots for history and tests for quality. The graph also preserves documented macros and ad-hoc analyses. Most implementation files were not sampled, so transformation links follow the README’s documented lineage; the empty main.py does not appear to implement a runtime entry point.

Main entry points: [`aws_dbt_snowflake_project/dbt_project.yml`](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/dbt_project.yml) (dbt project), [`aws_dbt_snowflake_project/models/silver`](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/models/silver) (Silver models), [`aws_dbt_snowflake_project/models/bronze`](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/models/bronze) (Bronze models), [`DDL/ddl.sql`](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/DDL/ddl.sql) (Snowflake staging)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_ingest["Data Ingestion"]
  node_csv["Airbnb CSVs"]
  node_s3["AWS S3"]
  node_staging[("Snowflake staging<br/>[ddl.sql]")]
  node_snowflake[("Snowflake warehouse")]
end

subgraph group_transform["Data Transformation"]
  node_dbt["dbt project<br/>[dbt_project.yml]"]
  node_sources["Source definitions<br/>[sources.yml]"]
  node_bronze["Bronze models"]
  node_silver["Silver models"]
  node_macros["Custom macros"]
end

subgraph group_analytics["Analytics Products"]
  node_gold_ephemeral["Ephemeral models"]
  node_fact["Fact model<br/>[fact.sql]"]
  node_obt["One Big Table<br/>[obt.sql]"]
  node_analysis["Ad-hoc analyses"]
end

subgraph group_operations["Quality and History"]
  node_snapshots["SCD snapshots"]
  node_quality["Data quality tests<br/>[source_tests.sql]"]
end

node_engineer(("Data engineer"))

node_engineer -->|"runs commands"| node_dbt
node_csv -->|"loads to"| node_s3
node_s3 -->|"loads to"| node_staging
node_staging -->|"defines inputs"| node_sources
node_sources -->|"feeds"| node_bronze
node_bronze -->|"cleans"| node_silver
node_silver -->|"feeds"| node_gold_ephemeral
node_gold_ephemeral -->|"supports"| node_fact
node_gold_ephemeral -->|"supports"| node_obt
node_dbt -->|"runs models"| node_bronze
node_dbt -->|"runs models"| node_silver
node_dbt -->|"runs models"| node_fact
node_dbt -->|"runs models"| node_obt
node_dbt -->|"runs snapshots"| node_snapshots
node_dbt -->|"runs tests"| node_quality
node_silver -->|"uses tagging"| node_macros
node_dbt -->|"hosts queries"| node_analysis
node_staging -->|"stores tables"| node_snowflake
node_bronze -->|"writes models"| node_snowflake
node_silver -->|"writes models"| node_snowflake
node_fact -->|"writes model"| node_snowflake
node_obt -->|"writes model"| node_snowflake
node_snapshots -->|"tracks history"| node_snowflake

click node_csv "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/SourceData"
click node_staging "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/DDL/ddl.sql"
click node_dbt "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/dbt_project.yml"
click node_sources "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/models/sources/sources.yml"
click node_bronze "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/models/bronze"
click node_silver "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/models/silver"
click node_macros "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/macros"
click node_gold_ephemeral "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/models/gold/ephemeral"
click node_fact "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/models/gold/fact.sql"
click node_obt "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/models/gold/obt.sql"
click node_snapshots "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/snapshots"
click node_quality "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/tests/source_tests.sql"
click node_analysis "https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/analyses"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_csv,node_s3,node_staging,node_snowflake toneBlue
class node_dbt,node_sources,node_bronze,node_silver,node_macros toneAmber
class node_gold_ephemeral,node_fact,node_obt,node_analysis toneMint
class node_snapshots,node_quality toneRose
class node_engineer toneIndigo
```

## Components

### Data Ingestion

- [Airbnb CSVs](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/SourceData): `SourceData`
- **AWS S3**
- [Snowflake staging](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/DDL/ddl.sql): `DDL/ddl.sql`
- **Snowflake warehouse**

### Data Transformation

- [dbt project](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/dbt_project.yml): `aws_dbt_snowflake_project/dbt_project.yml`
- [Source definitions](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/models/sources/sources.yml): `aws_dbt_snowflake_project/models/sources/sources.yml`
- [Bronze models](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/models/bronze): `aws_dbt_snowflake_project/models/bronze`
- [Silver models](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/models/silver): `aws_dbt_snowflake_project/models/silver`
- [Custom macros](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/macros): `aws_dbt_snowflake_project/macros`

### Analytics Products

- [Ephemeral models](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/models/gold/ephemeral): `aws_dbt_snowflake_project/models/gold/ephemeral`
- [Fact model](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/models/gold/fact.sql): `aws_dbt_snowflake_project/models/gold/fact.sql`
- [One Big Table](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/models/gold/obt.sql): `aws_dbt_snowflake_project/models/gold/obt.sql`
- [Ad-hoc analyses](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/analyses): `aws_dbt_snowflake_project/analyses`

### Quality and History

- [SCD snapshots](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/tree/main/aws_dbt_snowflake_project/snapshots): `aws_dbt_snowflake_project/snapshots`
- [Data quality tests](https://github.com/anshlambagit/airbnb_snowflake_dbt_data_engineer_project/blob/main/aws_dbt_snowflake_project/tests/source_tests.sql): `aws_dbt_snowflake_project/tests/source_tests.sql`

### Other components

- **Data engineer**

## Connections

- Data engineer → dbt project: runs commands (evidence: `README.md`)
- Airbnb CSVs → AWS S3: loads to (evidence: `README.md`)
- AWS S3 → Snowflake staging: loads to (evidence: `README.md`)
- Snowflake staging → Source definitions: defines inputs (evidence: `README.md`)
- Source definitions → Bronze models: feeds (evidence: `README.md`)
- Bronze models → Silver models: cleans (evidence: `README.md`)
- Silver models → Ephemeral models: feeds (evidence: `README.md`)
- Ephemeral models → Fact model: supports (evidence: `README.md`)
- Ephemeral models → One Big Table: supports (evidence: `README.md`)
- dbt project → Bronze models: runs models (evidence: `README.md`)
- dbt project → Silver models: runs models (evidence: `README.md`)
- dbt project → Fact model: runs models (evidence: `README.md`)
- dbt project → One Big Table: runs models (evidence: `README.md`)
- dbt project → SCD snapshots: runs snapshots (evidence: `README.md`)
- dbt project → Data quality tests: runs tests (evidence: `README.md`)
- Silver models → Custom macros: uses tagging (evidence: `README.md`)
- dbt project → Ad-hoc analyses: hosts queries (evidence: `README.md`)
- Snowflake staging → Snowflake warehouse: stores tables (evidence: `README.md`)
- Bronze models → Snowflake warehouse: writes models (evidence: `README.md`)
- Silver models → Snowflake warehouse: writes models (evidence: `README.md`)
- Fact model → Snowflake warehouse: writes model (evidence: `README.md`)
- One Big Table → Snowflake warehouse: writes model (evidence: `README.md`)
- SCD snapshots → Snowflake warehouse: tracks history (evidence: `README.md`)
