How ffauriza29/olist-analytics-portfolio works
This is an Olist e-commerce analytics pipeline: CSV files are loaded into BigQuery raw tables, dbt stages and transforms the data into business-facing marts, and those marts support BI and analysis. The README documents the major model capabilities and broad lineage; individual SQL model dependencies were not sampled, so the graph does not assert model-by-model joins.
Main entry points: olist_dbt dbt Runtime · ingest_data.py CSV Loader · stg_customers.sql Customers · stg_orders.sql Orders
Components 16
Data Ingestion
- CSV Loader
ingest_data.py
BigQuery Warehouse
- Raw Dataset
- Analytics Dataset
Silver Staging
- dbt Runtime
olist_dbt - Customers
olist_dbt/models/staging/stg_customers.sql - Orders
olist_dbt/models/staging/stg_orders.sql - Order Items
olist_dbt/models/staging/stg_order_items.sql - Order Payments
olist_dbt/models/staging/stg_order_payments.sql - Order Reviews
olist_dbt/models/staging/stg_order_reviews.sql - Products
olist_dbt/models/staging/stg_products.sql
Gold Marts
- Monthly Sales
olist_dbt/models/marts/fct_monthly_sales.sql - Customer Dimension
olist_dbt/models/marts/dim_customers.sql - Order Details
olist_dbt/models/marts/ct_order_details.sql
Other components
- Pipeline Operator
- Olist CSV Files
- BI Consumers
Connections 32
- Pipeline Operator → CSV Loader: runs loader
- Olist CSV Files → CSV Loader: reads files
- CSV Loader → Raw Dataset: loads tables
- Pipeline Operator → dbt Runtime: runs models
- Raw Dataset → Customers: source data
- Raw Dataset → Orders: source data
- Raw Dataset → Order Items: source data
- Raw Dataset → Order Payments: source data
- Raw Dataset → Order Reviews: source data
- Raw Dataset → Products: source data
- dbt Runtime → Customers: executes
- dbt Runtime → Orders: executes
- dbt Runtime → Order Items: executes
- dbt Runtime → Order Payments: executes
- dbt Runtime → Order Reviews: executes
- dbt Runtime → Products: executes
- Customers → Analytics Dataset: writes staging
- Orders → Analytics Dataset: writes staging
- Order Items → Analytics Dataset: writes staging
- Order Payments → Analytics Dataset: writes staging
- Order Reviews → Analytics Dataset: writes staging
- Products → Analytics Dataset: writes staging
- Analytics Dataset → Monthly Sales: staging inputs
- Analytics Dataset → Customer Dimension: staging inputs
- Analytics Dataset → Order Details: staging inputs
- dbt Runtime → Monthly Sales: executes
- dbt Runtime → Customer Dimension: executes
- dbt Runtime → Order Details: executes
- Monthly Sales → Analytics Dataset: writes mart
- Customer Dimension → Analytics Dataset: writes mart
- Order Details → Analytics Dataset: writes mart
- BI Consumers → Analytics Dataset: queries marts