# zinhlemm/track_waste_analysis architecture

> Architecture diagram of the GitHub repository zinhlemm/track_waste_analysis, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-09-12). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/zinhlemm/track_waste_analysis
- Repository: https://github.com/zinhlemm/track_waste_analysis

## Overview

##### Project type and purpose
- This is a hybrid data-analytics + deployment website project. It ingests multiple waste and emissions datasets, processes them through an ETL pipeline, stores results in a SQLite database, powers a Streamlit dashboard for waste-impact calculations and classification, and hosts a static marketing site with an embedded iframe to the dashboard.

##### File structure
- Top-level directories:
- data_integration (core ETL scripts and raw source folder)
- data_processed (cleaned CSV outputs)
- database (schema.sql + SQLite DB)
- raw_data (mirror of original data sources)
- scripts (auxiliary Python modules: integration, calculators, processors, tests, ERD visualizer)
- streamlit_app (Streamlit dashboard entrypoint app.py)
- track_my_impact (secondary copy of the DB for deployment)
- reports (design docs and architecture write-up)
- Config/build/deploy docs: BUILD_PLAN.md, DEPLOYMENT_SUMMARY.md, etc.
- requirements.txt pins Python dependencies.

##### README
- Confirms a static HTML/CSS/JS front-end (Tailwind CSS) hosting an embedded Streamlit dashboard.
- Lists features (responsive design, SEO, performance), tech stack (HTML5, Tailwind, JS, Streamlit), deployment targets (GitHub Pages, Netlify, etc.), and local dev instructions.

## Diagram (Mermaid)

```mermaid
flowchart TB
    %% External Data Sources
    subgraph "External Data Sources"
        direction TB
        RawData[(Raw Data Files)]:::dataStore
        DI_RawData[(ETL Package Raw Data)]:::dataStore
    end

    %% ETL Pipeline
    subgraph "ETL Pipeline" 
        direction TB
        MainETL["ETL: main_track_my_impact_app.py"]:::processing
        Aux1["data_integration.py"]:::processing
        Aux2["real_data_integration.py"]:::processing
        Aux3["simple_integration.py"]:::processing
    end

    %% Processed Data Store
    ProcessedData[(Cleaned CSVs)]:::dataStore

    %% Database
    subgraph "Relational Database"
        direction TB
        PrimaryDB[(SQLite DB)]:::dataStore
        DeploymentDB[(Deployment Copy DB)]:::dataStore
    end

    %% Business Logic Modules
    subgraph "Business Logic"
        direction TB
        ImpactCalc["Impact Calculator"]:::processing
        WarmProcessor["WARM Data Processor"]:::processing
        CNNReview["CNN Classification Review"]:::processing
    end

    %% Presentation Layers
    subgraph "Presentation Layers"
        direction TB
        StreamlitApp["Streamlit Dashboard"]:::presentation
        MarketingSite["Static Marketing Site"]:::presentation
    end

    %% Deployment Environments
    subgraph "Hosting"
        direction TB
        StaticHost["Static Host (Netlify/GH Pages)"]:::external
        StreamlitHost["Streamlit Server"]:::external
    end

    %% Users
    Users["End Users (Web Browser)"]:::external

    %% Data Flows
    RawData -->|extract| MainETL
    DI_RawData -->|extract| MainETL
    MainETL -->|transform| Aux1
    MainETL -->|transform| Aux2
    MainETL -->|transform| Aux3
    Aux1 -->|load| ProcessedData
    Aux2 -->|load| ProcessedData
    Aux3 -->|load| ProcessedData
    ProcessedData -->|load| PrimaryDB
    PrimaryDB -->|replicate| DeploymentDB

    %% Business Logic Flows
    PrimaryDB -->|query/write| ImpactCalc
    PrimaryDB -->|query/write| WarmProcessor
    PrimaryDB -->|query/write| CNNReview

    ImpactCalc -->|services| StreamlitApp
    WarmProcessor -->|services| StreamlitApp
    CNNReview -->|services| StreamlitApp
    PrimaryDB -->|data| StreamlitApp

    %% Presentation and Hosting
    StreamlitApp -->|iframe| MarketingSite
    MarketingSite --> StaticHost
    StreamlitApp --> StreamlitHost

    Users -->|visits| MarketingSite

    %% Click Events
    click RawData "https://github.com/zinhlemm/track_waste_analysis/tree/main/raw_data/"
    click DI_RawData "https://github.com/zinhlemm/track_waste_analysis/tree/main/data_integration/raw_data/"
    click MainETL "https://github.com/zinhlemm/track_waste_analysis/blob/main/data_integration/main_track_my_impact_app.py"
    click Aux1 "https://github.com/zinhlemm/track_waste_analysis/blob/main/scripts/data_integration.py"
    click Aux2 "https://github.com/zinhlemm/track_waste_analysis/blob/main/scripts/real_data_integration.py"
    click Aux3 "https://github.com/zinhlemm/track_waste_analysis/blob/main/scripts/simple_integration.py"
    click ProcessedData "https://github.com/zinhlemm/track_waste_analysis/tree/main/data_processed/"
    click PrimaryDB "https://github.com/zinhlemm/track_waste_analysis/blob/main/database/track_my_impact.db"
    click DeploymentDB "https://github.com/zinhlemm/track_waste_analysis/blob/main/track_my_impact/database/track_my_impact.db"
    click ImpactCalc "https://github.com/zinhlemm/track_waste_analysis/blob/main/scripts/impact_calculator.py"
    click WarmProcessor "https://github.com/zinhlemm/track_waste_analysis/blob/main/scripts/warm_data_processor.py"
    click CNNReview "https://github.com/zinhlemm/track_waste_analysis/blob/main/cnn_waste_classification_review.md"
    click StreamlitApp "https://github.com/zinhlemm/track_waste_analysis/blob/main/streamlit_app/app.py"

    %% Styles
    classDef dataStore fill:#BBDEFB,stroke:#1976D2,stroke-width:2px
    classDef processing fill:#C8E6C9,stroke:#388E3C,stroke-width:2px
    classDef presentation fill:#FFE0B2,stroke:#F57C00,stroke-width:2px
    classDef external fill:#E0E0E0,stroke:#757575,stroke-width:2px
```
