# bintangx2005-netizen/eds-olist-customer-intelligence architecture

> Architecture diagram of the GitHub repository bintangx2005-netizen/eds-olist-customer-intelligence, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-21). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/bintangx2005-netizen/eds-olist-customer-intelligence
- Repository: https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence

## Overview

Ini adalah platform intelijen pelanggan Olist: ETL Python menggabungkan CSV transaksi dan cuaca, menerapkan pemeriksaan/pembersihan kualitas, membentuk warehouse bintang, lalu menyajikan analitik melalui dashboard Streamlit. README mendokumentasikan halaman Executive Overview, Customer 360/RFM, Pengiriman dan Review, Insight dan Rekomendasi, serta Monitor Data Quality. Relasi yang tidak tampak jelas pada cuplikan—terutama transformasi dan pemuatan bertahap—tidak diasumsikan sebagai panggilan terverifikasi.

Main entry points: [`etl/run.py`](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/run.py) (Orkestrasi ETL), [`etl/db.py`](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/db.py) (Akses PostgreSQL), [`etl/verify.py`](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/verify.py) (Verifikasi hasil), [`etl/weather.py`](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/weather.py) (Ambil cuaca)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_ingest["Ingesti dan ETL"]
  node_extract["Baca CSV<br/>[extract.py]"]
  node_weather["Ambil cuaca<br/>[weather.py]"]
  node_weatherfile["Cuaca tersimpan"]
  node_orchestrator["Orkestrasi ETL<br/>[run.py]"]
  node_quality["Kualitas dan pembersihan<br/>[quality.py]"]
  node_text["Topik review<br/>[text.py]"]
  node_transform["Fakta dan dimensi<br/>[transform.py]"]
  node_config["Konfigurasi ETL<br/>[config.py]"]
end

subgraph group_warehouse["Warehouse dan Mart"]
  node_dbaccess["Akses PostgreSQL<br/>[db.py]"]
  node_staging[("Staging")]
  node_warehouse_db[("Warehouse dan ops")]
  node_schema["Skema dan role<br/>[01_schema.sql]"]
  node_views["View mart dan KPI<br/>[02_views.sql]"]
end

subgraph group_analytics["Analitik Produk"]
  node_dashboard["Dashboard lima halaman<br/>[app.py]"]
  node_verify["Verifikasi hasil<br/>[verify.py]"]
end

node_customer(("Pengguna analitik"))
node_olist["CSV Olist"]
node_meteo{{"Open-Meteo"}}

node_customer -->|"menggunakan"| node_dashboard
node_olist -->|"dibaca sebagai CSV"| node_extract
node_meteo -->|"menyediakan cuaca"| node_weather
node_weather -->|"menyimpan CSV"| node_weatherfile
node_orchestrator -->|"memanggil ekstraksi"| node_extract
node_orchestrator -->|"memanggil cuaca"| node_weather
node_orchestrator -->|"mengukur dan membersihkan"| node_quality
node_orchestrator -.->|"membangun warehouse"| node_transform
node_orchestrator -->|"mengakses database"| node_dbaccess
node_orchestrator -->|"menjalankan verifikasi"| node_verify
node_transform -->|"menghitung topik"| node_text
node_dbaccess -->|"memuat data mentah"| node_staging
node_dbaccess -->|"menyalin tabel"| node_warehouse_db
node_schema -->|"mendefinisikan skema"| node_warehouse_db
node_views -->|"membaca warehouse"| node_warehouse_db
node_dashboard -->|"membaca view mart"| node_views
node_verify -->|"memeriksa baris"| node_warehouse_db
node_verify -->|"memeriksa KPI"| node_views

click node_extract "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/extract.py"
click node_weather "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/weather.py"
click node_weatherfile "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/data/external/weather_state_daily.csv"
click node_orchestrator "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/run.py"
click node_quality "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/quality.py"
click node_text "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/text.py"
click node_transform "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/transform.py"
click node_config "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/config.py"
click node_dbaccess "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/db.py"
click node_schema "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/sql/01_schema.sql"
click node_views "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/sql/02_views.sql"
click node_dashboard "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/dashboard/app.py"
click node_verify "https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/verify.py"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_extract,node_weather,node_weatherfile,node_orchestrator,node_quality,node_text,node_transform,node_config toneBlue
class node_dbaccess,node_staging,node_warehouse_db,node_schema,node_views toneAmber
class node_dashboard,node_verify toneMint
class node_customer,node_olist,node_meteo toneIndigo
```

## Components

### Ingesti dan ETL

- [Baca CSV](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/extract.py): `etl/extract.py`
- [Ambil cuaca](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/weather.py): `etl/weather.py`
- [Cuaca tersimpan](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/data/external/weather_state_daily.csv): `data/external/weather_state_daily.csv`
- [Orkestrasi ETL](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/run.py): `etl/run.py`
- [Kualitas dan pembersihan](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/quality.py): `etl/quality.py`
- [Topik review](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/text.py): `etl/text.py`
- [Fakta dan dimensi](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/transform.py): `etl/transform.py`
- [Konfigurasi ETL](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/config.py): `etl/config.py`

### Warehouse dan Mart

- [Akses PostgreSQL](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/db.py): `etl/db.py`
- **Staging**
- **Warehouse dan ops**
- [Skema dan role](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/sql/01_schema.sql): `sql/01_schema.sql`
- [View mart dan KPI](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/sql/02_views.sql): `sql/02_views.sql`

### Analitik Produk

- [Dashboard lima halaman](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/dashboard/app.py): `dashboard/app.py`
- [Verifikasi hasil](https://github.com/bintangx2005-netizen/eds-olist-customer-intelligence/blob/main/etl/verify.py): `etl/verify.py`

### Other components

- **Pengguna analitik**
- **CSV Olist**
- **Open-Meteo**

## Connections

- Pengguna analitik → Dashboard lima halaman: menggunakan (evidence: `README.md`)
- CSV Olist → Baca CSV: dibaca sebagai CSV (evidence: `etl/extract.py`)
- Open-Meteo → Ambil cuaca: menyediakan cuaca (evidence: `etl/weather.py`)
- Ambil cuaca → Cuaca tersimpan: menyimpan CSV (evidence: `etl/weather.py`)
- Orkestrasi ETL → Baca CSV: memanggil ekstraksi (evidence: `etl/run.py`)
- Orkestrasi ETL → Ambil cuaca: memanggil cuaca (evidence: `etl/run.py`)
- Orkestrasi ETL → Kualitas dan pembersihan: mengukur dan membersihkan (evidence: `etl/run.py`)
- Orkestrasi ETL → Fakta dan dimensi: membangun warehouse (evidence: `etl/run.py`)
- Orkestrasi ETL → Akses PostgreSQL: mengakses database (evidence: `etl/run.py`)
- Orkestrasi ETL → Verifikasi hasil: menjalankan verifikasi (evidence: `etl/run.py`)
- Fakta dan dimensi → Topik review: menghitung topik (evidence: `etl/transform.py`)
- Akses PostgreSQL → Staging: memuat data mentah (evidence: `etl/db.py`)
- Akses PostgreSQL → Warehouse dan ops: menyalin tabel (evidence: `etl/db.py`)
- Skema dan role → Warehouse dan ops: mendefinisikan skema (evidence: `README.md`)
- View mart dan KPI → Warehouse dan ops: membaca warehouse (evidence: `README.md`)
- Dashboard lima halaman → View mart dan KPI: membaca view mart (evidence: `dashboard/app.py`)
- Verifikasi hasil → Warehouse dan ops: memeriksa baris (evidence: `etl/verify.py`)
- Verifikasi hasil → View mart dan KPI: memeriksa KPI (evidence: `etl/verify.py`)
