# cicifly/data-analytics-projects architecture

> Architecture diagram of the GitHub repository cicifly/data-analytics-projects, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-09-13). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/cicifly/data-analytics-projects
- Repository: https://github.com/cicifly/data-analytics-projects

## Overview

##### Project type and purpose
- This repository is not a traditional client/server or microservices app but a portfolio of data-analysis pipelines implemented as Jupyter notebooks.
- Its purpose is to demonstrate end-to-end data-analysis projects (data ingestion, cleaning, exploration, statistical testing, visualization, reporting) using Python (NumPy, pandas, Matplotlib, Seaborn) and SQL where applicable.

##### File structure
- Top-level: one README.md plus multiple project folders (“Intro to Data Analysis…”, “Data Wrangle and Analyze with Twitter WeRateDogs…”, etc.).
- Each project folder contains:
- raw data files (CSV, TSV, JSON, ZIP)
- one or more Jupyter notebooks (.ipynb)
- exported HTML reports or slide decks (.html, .slides.html)
- sometimes PDF or Markdown docs
- No backend, frontend, or service directories—everything runs in a local/conda environment.

##### README insights
- Walks through Udacity Nanodegree modules: data cleaning, statistics, wrangling, visualization.
- Specifies core libraries: numpy, pandas, scipy, scikit-learn, matplotlib, seaborn.
- Mentions use of Jupyter and Anaconda.

a. Data Sources
- External datasets (CSV/TSV/JSON/ZIP) per project
- Udacity’s curated datasets or public APIs (e.g., Twitter archive for WeRateDogs)
b. Data Storage
- Local project-folder storage in GitHub repo
- Could be represented as “Raw Data” nodes
c. Processing Environment
- Anaconda environment (Python interpreter + libraries)
- Jupyter Notebook server as the orchestration layer
d. Data-Cleaning & Wrangling
- pandas-based cleaning modules embedded in notebooks
- SQL queries if a PostgreSQL subset is used (not evident in file tree but implied by SQL mention)
e. Analysis & Modeling
- Statistical methods (A/B testing, regressions)
- Data visualization routines (Matplotlib, Seaborn)
f. Reporting & Presentation
- Notebook exports to HTML or slide decks
- PDF or Markdown summaries
g. Version Control & Collaboration
- Git/GitHub for source-control of notebooks, data pointers, READMEs

##### Relationships & interactions
- Within Jupyter: sequential flow: Cleaning → Analysis → Visualization.

##### Architectural patterns & principles
- Pipeline pattern: linear ETL (Extract→Transform→Load→Analyze→Report).
- Modularity: one notebook per project, each self-contained.
- Reproducibility: conda environment + notebook code ensures analyses can be rerun.

##### Key technologies & libraries
- Python
- Jupyter Notebook
- NumPy, pandas, Matplotlib, Seaborn, SciPy, scikit-learn
- (optional) SQL/PostgreSQL
- Git/GitHub

## Diagram (Mermaid)

```mermaid
flowchart TB
    %% Version Control
    VC["README.md"]:::version
    click VC "https://github.com/cicifly/data-analytics-projects/blob/master/README.md"

    %% Data Sources
    subgraph "Data Sources"
        DS1["ab_data.csv"]:::storage
        DS2["countries.csv"]:::storage
        DS3["Ford_Go_Bike_Dataset (ZIP)"]:::storage
        DS4["Fuel_Economy_Data (CSV)"]:::storage
        DS5["Phase2_Clinic_Trial_Data (CSV)"]:::storage
        DS6["WeRateDogs_Data (TSV/TXT)"]:::storage
    end
    click DS1 "https://github.com/cicifly/data-analytics-projects/blob/master/AB Testing Result Analyze/ab_data.csv"
    click DS2 "https://github.com/cicifly/data-analytics-projects/blob/master/AB Testing Result Analyze/countries.csv"
    click DS3 "https://github.com/cicifly/data-analytics-projects/tree/master/Communicate Data Findings with Ford Bike Sharing Data/Ford_Go_Bike_Dataset/"
    click DS4 "https://github.com/cicifly/data-analytics-projects/tree/master/Data Analytics with Fuel Economy Data/Fuel_Economy_Data/"
    click DS5 "https://github.com/cicifly/data-analytics-projects/tree/master/Data Wrangle and Analyze with Phase2 Clinic Trial Data/"
    click DS6 "https://github.com/cicifly/data-analytics-projects/tree/master/Data Wrangle and Analyze with Twitter WeRateDogs Data Set/Project4_Data/"

    %% Data Storage
    subgraph "Data Storage (Raw Data)" 
        Storage[(Raw Data Storage)]:::storage
    end

    %% Processing Environment
    subgraph "Processing Environment"
        Env1["Anaconda Environment"]:::compute
        Env2["Jupyter Notebook Server"]:::compute
    end

    %% Pipeline Steps
    subgraph "Data Cleaning & Wrangling"
        Clean1["Data_Wangle_Phase_II_Clinical_Trial_Dataset.ipynb"]:::compute
        Clean2["Wrangle_Act_with_WeRateDog_Data.ipynb"]:::compute
    end

    subgraph "Analysis & Modeling"
        Model1["Analyze_ab_test_results_notebook.ipynb"]:::compute
        Model2["Xi_Zhou_Project2_Investigate_Dataset_Movies_version2.ipynb"]:::compute
        Model3["Data-Exploration-with-Bike-Data.ipynb"]:::compute
        Model4["Data Analysis with Fuel Economy Data.ipynb"]:::compute
    end

    subgraph "Reporting & Presentation"
        Report1["Analyze_ab_test_results_notebook.html"]:::report
        Report2["Bike_Data_Report.html/slides"]:::report
        Report3["WeRateDogs_Report.html"]:::report
        Report4["Movie_Data_Report.html"]:::report
    end

    click Clean1 "https://github.com/cicifly/data-analytics-projects/blob/master/Data Wrangle and Analyze with Phase2 Clinic Trial Data/Data_Wangle_Phase_II_ Clinical_Trial_Dataset .ipynb"
    click Clean2 "https://github.com/cicifly/data-analytics-projects/blob/master/Data Wrangle and Analyze with Twitter WeRateDogs Data Set/Wrangle Act  with WeRateDog Data.ipynb"
    click Model1 "https://github.com/cicifly/data-analytics-projects/blob/master/AB Testing Result Analyze/Analyze_ab_test_results_notebook.ipynb"
    click Model2 "https://github.com/cicifly/data-analytics-projects/blob/master/Data Analytics with Movie Data/Xi_Zhou_Project2_Investigate_Dataset_Movies_version2.ipynb"
    click Model3 "https://github.com/cicifly/data-analytics-projects/blob/master/Communicate Data Findings with Ford Bike Sharing Data/Data-Exploration-with-Bike-Data.ipynb"
    click Model4 "https://github.com/cicifly/data-analytics-projects/blob/master/Data Analytics with Fuel Economy Data/Data Analysis with Fuel Economy Data .ipynb"
    click Report1 "https://github.com/cicifly/data-analytics-projects/blob/master/AB Testing Result Analyze/Analyze_ab_test_results_notebook.html"
    click Report2 "https://github.com/cicifly/data-analytics-projects/tree/master/Communicate Data Findings with Ford Bike Sharing Data/"
    click Report3 "https://github.com/cicifly/data-analytics-projects/tree/master/Data Wrangle and Analyze with Twitter WeRateDogs Data Set/"
    click Report4 "https://github.com/cicifly/data-analytics-projects/tree/master/Data Analytics with Movie Data/"

    %% Connections
    DS1 -->|"sources"| Storage
    DS2 --> Storage
    DS3 --> Storage
    DS4 --> Storage
    DS5 --> Storage
    DS6 --> Storage

    Storage -->|"ingest"| Env2
    Env1 --> Env2

    Env2 --> Clean1
    Env2 --> Clean2

    Clean1 -->|"clean()"| Model1
    Clean2 -->|"clean()"| Model3

    Model1 -->|"analyze()"| Report1
    Model2 -->|"analyze()"| Report4
    Model3 -->|"analyze()"| Report2
    Model4 -->|"analyze()"| Report3

    Model1 --> Model2
    Model2 --> Model4

    Report1 -->|"publish"| VC
    Report2 --> VC
    Report3 --> VC
    Report4 --> VC

    %% Styles
    classDef storage fill:#ADD8E6,stroke:#000,stroke-width:1px
    classDef compute fill:#90EE90,stroke:#000,stroke-width:1px
    classDef report fill:#FFA500,stroke:#000,stroke-width:1px
    classDef version fill:#D3D3D3,stroke:#000,stroke-width:1px
```
