# victor-antoniassi/data_portfolio architecture

> Architecture diagram of the GitHub repository victor-antoniassi/data_portfolio, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-01-22). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/victor-antoniassi/data_portfolio
- Repository: https://github.com/victor-antoniassi/data_portfolio

## Overview

##### High-Level Portfolio Overview
- Divide it into two main sections:
a. Technical Assessment Projects
b. Code Snippets & Practice Projects

##### Project-Specific Architecture

A. Video Game Sales Project
- Components:
- Data Source (HTTPS)
- Prefect Orchestration Layer
- Python Processing Layer (Pandas)
- DuckDB Storage
- Analysis Outputs
- HTTPS → Prefect → Python → DuckDB → Analysis

B. School Supplies Market Project
- Components:
- Google Sheets Input
- Python Processing Layer
- Data Quality Validation System
- SQLite Database
- Analytics Output
- Flow:
- Google Sheets → Python → Validation → SQLite → Analytics

C. Cryptocurrencies Quotes Project
- Components:
- CoinMarketCap API
- Python EL Pipeline
- Error Handling System
- DuckDB Storage
- Flow:
- API → Python Pipeline → DuckDB

##### Technology Stack Indicators
- Python (3.9+)
- DuckDB
- SQLite
- Prefect
- Pandas
- dlt
- Version numbers where critical

## Diagram (Mermaid)

```mermaid
graph TB
    subgraph Portfolio["Data Portfolio"]
        direction TB
        
        subgraph TechAssessment["Technical Assessment Projects"]
            direction TB
            
            subgraph VideoGame["Video Game Sales Project"]
                direction TB
                VGSource["HTTPS Data Source"]:::source
                VGPrefect["Prefect Orchestration"]:::processing
                VGPython["Python/Pandas Processing"]:::processing
                VGDuck["DuckDB Storage"]:::storage
                VGAnalysis["Analysis Outputs"]:::output
                
                VGSource --> VGPrefect
                VGPrefect --> VGPython
                VGPython --> VGDuck
                VGDuck --> VGAnalysis
            end
            
            subgraph SchoolSupplies["School Supplies Market Project"]
                direction TB
                SSSource["Google Sheets Input"]:::source
                SSPython["Python Processing"]:::processing
                SSValidation["Data Quality Validation"]:::validation
                SSSQLite["SQLite Database"]:::storage
                SSAnalytics["Analytics Output"]:::output
                
                SSSource --> SSPython
                SSPython --> SSValidation
                SSValidation --> SSSQLite
                SSSQLite --> SSAnalytics
            end
            
            subgraph Crypto["Cryptocurrencies Quotes Project"]
                direction TB
                CryptoAPI["CoinMarketCap API"]:::source
                CryptoPipeline["Python EL Pipeline"]:::processing
                CryptoError["Error Handling"]:::validation
                CryptoDB["DuckDB Storage"]:::storage
                
                CryptoAPI --> CryptoPipeline
                CryptoPipeline --> CryptoError
                CryptoError --> CryptoDB
            end
        end
        
        subgraph CodeSnippets["Code Snippets & Practice Projects"]
            direction TB
            Snippets["Various Code Examples"]:::output
        end
    end
    
    %% Styling
    classDef source fill:#3498db,stroke:#2980b9,color:white
    classDef processing fill:#2ecc71,stroke:#27ae60,color:white
    classDef validation fill:#f1c40f,stroke:#f39c12,color:black
    classDef storage fill:#e74c3c,stroke:#c0392b,color:white
    classDef output fill:#9b59b6,stroke:#8e44ad,color:white
    
    %% Legend
    subgraph Legend
        direction TB
        L1["Data Source"]:::source
        L2["Processing System"]:::processing
        L3["Validation"]:::validation
        L4["Storage"]:::storage
        L5["Output"]:::output
    end
```
