# abcasas/capstones_cidaen_22_24 architecture

> Architecture diagram of the GitHub repository abcasas/capstones_cidaen_22_24, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-03-28). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/abcasas/capstones_cidaen_22_24
- Repository: https://github.com/abcasas/capstones_cidaen_22_24

## Overview

##### Main Components
- Data Source & Ingestion: Several modules have “data” folders containing CSV files and backups (for example, in “mc3-m01”, “mc3-m02”, etc.). This indicates that the project begins with raw data acquisition.
- Data Preparation / Storage: The “mc3-m02-Acquisition, preparation, and storage of data” module shows that data ingestion is complemented by steps to prepare and store data.
- Exploratory Data Analysis (EDA): The “mc3-m03-Exploratory Data Analysis” folder encapsulates notebooks for analyzing and visualizing data.
- Machine Learning & Deep Learning: Modules such as “mc3-m04-Fundamentals of Machine Learning” and “mc3-m06-Deep Learning” represent the model building and training components.
- Specialized Analyses: Modules on “Time series” and “Text Mining, Networks, and Recommendation Systems” point to domain-specific analytical components.
- Big Data Architectures: The “mc3-m12-Big Data Architectures and Processes” module (with Docker configurations and notebooks) suggests integration with big data workflows and environments.
- Deployment & Services: The “mc3-m14-Creation and Deployment of Services” includes deployment scripts, Docker files, and service application components (app.py, appspec, etc.), highlighting the transformation of analytics into deployable services.
- Support/Infrastructure Components: Dockerfiles, docker-compose, and .devcontainer configurations are used for containerization and development environment consistency.

##### Relationships and Interactions
- Modular and Independent Capstones: Although each module stands on its own (as evident from separate folders and capstone notebooks), later modules such as deployment and big data architectures can be seen as integrating or building upon insights from earlier stages.
- Integration Points: Highlight the role of containerization and orchestration (Docker, docker-compose) in facilitating consistent environments and deployment strategies.

##### Architectural Patterns and Design Principles
- Data Pipeline Pattern: The project naturally follows a pipeline pattern—from acquisition, cleaning, exploration, and modeling to deployment.
- Modularity: Each module is self-contained, which makes it easier to update individual capstone projects as needed, demonstrating a highly modular design.
- Containerization: In the “Time series”, “Big Data”, and “Service Deployment” modules, the use of Docker (Dockerfile and docker-compose.yml) supports a modern, containerized deployment approach.
- Clear Separation of Concerns: The structure clearly separates data preparation, analysis, model training, and service deployment, which encourages maintainability and scalability.

##### Relevant Technologies and Frameworks
- Jupyter Notebooks: Most of the logic and analysis is implemented through notebooks (Capstone I–VIII, etc.).
- Data Handling Tools: CSV files indicate the use of standard data manipulation libraries (likely pandas in Python).
- Docker: Presence of Dockerfiles and docker-compose indicates containerization is part of some modules (particularly in “mc3-m07-Time series”, “mc3-m12-Big Data Architectures”, and “mc3-m14-Creation and Deployment of Services”).
- Python and Related Libraries: Although not explicitly listed, the naming and layout strongly suggest Python as the primary programming language for analysis, data science, and modeling.
- Deployment Scripts: The “scripts” folders and appspec files are part of automating service deployment.

## Diagram (Mermaid)

```mermaid
flowchart TD
    subgraph "Data Ingestion & Preparation"
        A1["Capstone I: Basic Tools (Data Source)"]
        A2["Capstone II: Acquisition & Storage"]
    end

    subgraph "Data Analysis & Modeling"
        B1["Capstone III: Exploratory Data Analysis"]
        B2["Capstone IV: Fundamentals of Machine Learning"]
        B3["Capstone VI: Deep Learning"]
    end

    subgraph "Specialized Analysis & Deployment"
        C1["Capstone VII: Time Series Analysis"]
        C2["Capstone VIII: Text Mining, Networks & Recommendation Systems"]
        C3["Capstone XII: Big Data Architectures"]
        C4["Capstone XIV: Deployment & Services"]
    end

    A1 --> A2
    A2 --> B1
    B1 --> B2
    B2 --> B3
    B3 --> C1
    C1 --> C2
    C2 --> C3
    C3 --> C4

    classDef data fill:#ADD8E6,stroke:#000,stroke-width:2px;
    classDef modeling fill:#90EE90,stroke:#000,stroke-width:2px;
    classDef deployment fill:#FFA500,stroke:#000,stroke-width:2px;

    class A1,A2 data;
    class B1,B2,B3 modeling;
    class C1,C2,C3,C4 deployment;

    click A1 "https://github.com/abcasas/capstones_cidaen_22_24/tree/main/mc3-m01-Introduction to Data Science. Basic Tools/data"
    click A2 "https://github.com/abcasas/capstones_cidaen_22_24/tree/main/mc3-m02-Acquisition, preparation, and storage of data"
    click B1 "https://github.com/abcasas/capstones_cidaen_22_24/tree/main/mc3-m03-Exploratory Data Analysis"
    click B2 "https://github.com/abcasas/capstones_cidaen_22_24/tree/main/mc3-m04-Fundamentals of Machine Learning"
    click B3 "https://github.com/abcasas/capstones_cidaen_22_24/tree/main/mc3-m06-Deep Learning"
    click C1 "https://github.com/abcasas/capstones_cidaen_22_24/tree/main/mc3-m07-Time series"
    click C2 "https://github.com/abcasas/capstones_cidaen_22_24/tree/main/mc3-m08-Text Mining, Networks, and Recommendation Systems"
    click C3 "https://github.com/abcasas/capstones_cidaen_22_24/tree/main/mc3-m12-Big Data Architectures and Processes"
    click C4 "https://github.com/abcasas/capstones_cidaen_22_24/tree/main/mc3-m14-Creation and Deployment of Services"
```
