# sunsikim/aws-mla-c01 architecture

> Architecture diagram of the GitHub repository sunsikim/aws-mla-c01, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-05-21). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/sunsikim/aws-mla-c01
- Repository: https://github.com/sunsikim/aws-mla-c01

## Overview

This repository is a documentation-only course notes repo for the AWS Machine Learning Associate certification. There is no application runtime or executable service layer; the “architecture” here is the learning path itself, organized around the end-to-end ML lifecycle on AWS.

1. **Top-level structure**
   The repo is split into four major parts that map directly to the ML workflow:
   - data preparation
   - model preparation
   - model deployment
   - pipeline management  
   This gives it a pipeline-oriented architecture rather than a product/code architecture.

2. **Part 1: Data preparation**
   `part1-data-preparation` covers the upstream data layer. It is divided into:
   - ingestion and storage
   - data transformation  
   This is the foundation for everything else: raw data is brought in, persisted, then prepared for analytics or training.

3. **Ingestion boundary**
   In `chapter1-ingestion-and-storage/section1-ingestion-kinesis`, the focus is on streaming ingestion through AWS Kinesis. Architecturally, this is the entry point for real-time or near-real-time data feeds before they land in durable storage.

4. **Storage boundary**
   Storage is split across object and file/block services:
   - `section2-storage-s3` for durable object storage and data lakes
   - `section3-storage-ebs-efs-fsx` for compute-attached or shared file/storage systems  
   This reflects a key design boundary: S3 for centralized, scalable datasets; EBS/EFS/FSx for workloads needing mounted storage semantics.

5. **Transformation layer**
   `part1-data-preparation/chapter2-data-transformation` has two concerns:
   - querying
   - wrangling  
   This layer consumes data from storage and prepares it for downstream ML use, separating data access/analysis from data cleaning and feature shaping.

6. **Part 2: Model preparation**
   `part2-model-preparation` moves from data to modeling. It includes:
   - AWS managed services
   - model training
   - generative AI  
   Architecturally, this is where prepared data becomes training inputs, and where AWS-managed ML capabilities are introduced as abstractions over infrastructure.

7. **Training subsystem**
   `chapter2-model-training` is split between:
   - modeling theories
   - SageMaker training  
   This indicates a mix of conceptual ML topics and AWS-specific training execution. SageMaker is the primary managed training boundary in the repo’s architecture.

8. **Generative AI as a separate concern**
   `chapter3-generative-ai` is isolated from standard training because it introduces a distinct modeling paradigm and likely different AWS services and patterns. Its separate placement suggests the repo treats GenAI as an extension of the ML lifecycle, not just another training variant.

9. **Part 3: Model deployment**
   `part3-model-deployment` covers serving models in two ways:
   - `chapter1-docker-endpoint`
   - `chapter2-sagemaker-endpoint`  
   This shows a deployment boundary between container-based serving and managed SageMaker inference endpoints.

10. **Deployment patterns**
   The Docker endpoint section implies self-managed or containerized inference infrastructure, while the SageMaker endpoint section represents AWS-managed model serving. Together, they frame the tradeoff between operational control and managed simplicity.

11. **Part 4: Pipeline management**
   `part4-pipeline-management` handles production concerns:
   - security
   - monitoring  
   These are cross-cutting controls that sit around ingestion, training, and deployment rather than inside one stage. They define the operational envelope for an ML system on AWS.

12. **System flow implied by the repo**
   The overall flow is:
   data ingestion → storage → querying/wrangling → training → deployment → security/monitoring  
   In AWS terms, the repo emphasizes Kinesis and S3 early, SageMaker for training and serving, and operational governance as the final layer.

13. **What this repo is not**
   This is not a service implementation repo, not a library, and not an application with runtime components. It is structured course material that documents an ML platform architecture on AWS.

14. **Diagramming takeaway**
   If you draw an architecture diagram from this repo, it should center on a data-to-model-to-serving pipeline with AWS services as the major infrastructure blocks, and with security/monitoring as a surrounding operational layer.

Main entry points: [`part2-model-preparation`](https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation) (Model Prep), [`README.md`](https://github.com/sunsikim/aws-mla-c01/blob/master/README.md) (Course Notes), [`part1-data-preparation/chapter1-ingestion-and-storage`](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter1-ingestion-and-storage) (Ingest & Store), [`part1-data-preparation`](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation) (Data Prep)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_group_part1["Part 1"]
  node_part1["Data Prep<br/>learning path"]
  node_p1_ch1["Ingest & Store<br/>chapter"]
  node_p1_kinesis(("Kinesis Ingest<br/>stream ingestion"))
  node_p1_s3[("S3 Storage<br/>object storage")]
  node_p1_efs[("EBS/EFS/FSx<br/>file storage")]
  node_p1_ch2["Transform<br/>chapter"]
  node_p1_query["Querying<br/>analysis"]
  node_p1_wrang["Wrangling<br/>prep"]
end

subgraph group_group_part2["Part 2"]
  node_part2["Model Prep<br/>learning path"]
  node_p2_managed["Managed Services<br/>AWS services"]
  node_p2_train["Model Train<br/>chapter"]
  node_p2_theory["Theories<br/>ML concepts"]
  node_p2_sagemaker_train(("SageMaker Train<br/>managed training"))
  node_p2_genai["GenAI<br/>modeling paradigm"]
end

subgraph group_group_part3["Part 3"]
  node_part3["Deployment<br/>learning path"]
  node_p3_docker(("Docker EP<br/>container endpoint"))
  node_p3_sm_ep(("SageMaker EP<br/>managed endpoint"))
end

subgraph group_group_part4["Part 4"]
  node_part4["Ops<br/>learning path"]
  node_p4_sec["Security<br/>governance"]
  node_p4_mon["Monitoring<br/>observability"]
end

node_repo_root["Course Notes<br/>documentation root<br/>[README.md]"]

node_repo_root -->|"covers"| node_part1
node_repo_root -->|"covers"| node_part2
node_repo_root -->|"covers"| node_part3
node_repo_root -->|"covers"| node_part4
node_part1 -->|"includes"| node_p1_ch1
node_part1 -->|"includes"| node_p1_ch2
node_p1_ch1 -->|"entry"| node_p1_kinesis
node_p1_ch1 -->|"stores"| node_p1_s3
node_p1_ch1 -->|"stores"| node_p1_efs
node_p1_ch2 -->|"splits into"| node_p1_query
node_p1_ch2 -->|"splits into"| node_p1_wrang
node_p1_s3 -->|"feeds"| node_p1_query
node_p1_s3 -->|"feeds"| node_p1_wrang
node_part2 -->|"includes"| node_p2_managed
node_part2 -->|"includes"| node_p2_train
node_part2 -->|"includes"| node_p2_genai
node_p2_train -->|"grounds"| node_p2_theory
node_p2_train -->|"executes"| node_p2_sagemaker_train
node_p1_wrang -->|"inputs"| node_p2_train
node_p2_sagemaker_train -->|"deploys to"| node_p3_sm_ep
node_part3 -->|"includes"| node_p3_docker
node_part3 -->|"includes"| node_p3_sm_ep
node_part4 -->|"includes"| node_p4_sec
node_part4 -->|"includes"| node_p4_mon
node_p4_sec -.->|"paired with"| node_p4_mon
node_p4_sec -.->|"governs"| node_part1
node_p4_mon -.->|"observes"| node_part2
node_p4_mon -.->|"observes"| node_part3

click node_repo_root "https://github.com/sunsikim/aws-mla-c01/blob/master/README.md"
click node_part1 "https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation"
click node_p1_ch1 "https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter1-ingestion-and-storage"
click node_p1_kinesis "https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter1-ingestion-and-storage/section1-ingestion-kinesis"
click node_p1_s3 "https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter1-ingestion-and-storage/section2-storage-s3"
click node_p1_efs "https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter1-ingestion-and-storage/section3-storage-ebs-efs-fsx"
click node_p1_ch2 "https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter2-data-transformation"
click node_p1_query "https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter2-data-transformation/section1-querying"
click node_p1_wrang "https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter2-data-transformation/section2-wrangling"
click node_part2 "https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation"
click node_p2_managed "https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter1-aws-managed-services"
click node_p2_train "https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter2-model-training"
click node_p2_theory "https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter2-model-training/section1-modeling-theories"
click node_p2_sagemaker_train "https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter2-model-training/section2-sagemaker-training"
click node_p2_genai "https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter3-generative-ai"
click node_part3 "https://github.com/sunsikim/aws-mla-c01/tree/master/part3-model-deployment"
click node_p3_docker "https://github.com/sunsikim/aws-mla-c01/tree/master/part3-model-deployment/chapter1-docker-endpoint"
click node_p3_sm_ep "https://github.com/sunsikim/aws-mla-c01/tree/master/part3-model-deployment/chapter2-sagemaker-endpoint"
click node_part4 "https://github.com/sunsikim/aws-mla-c01/tree/master/part4-pipeline-management"
click node_p4_sec "https://github.com/sunsikim/aws-mla-c01/tree/master/part4-pipeline-management/chapter1-security"
click node_p4_mon "https://github.com/sunsikim/aws-mla-c01/tree/master/part4-pipeline-management/chapter2-monitoring"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_part1,node_p1_ch1,node_p1_kinesis,node_p1_s3,node_p1_efs,node_p1_ch2,node_p1_query,node_p1_wrang toneBlue
class node_part2,node_p2_managed,node_p2_train,node_p2_theory,node_p2_sagemaker_train,node_p2_genai toneAmber
class node_part3,node_p3_docker,node_p3_sm_ep toneMint
class node_part4,node_p4_sec,node_p4_mon toneRose
class node_repo_root toneNeutral
```

## Components

### Part 1

Data preparation

- [Data Prep](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation): learning path · Upstream data preparation for ML workflows · `part1-data-preparation`
- [Ingest & Store](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter1-ingestion-and-storage): chapter · Data ingress and durable storage boundaries · `part1-data-preparation/chapter1-ingestion-and-storage`
- [Kinesis Ingest](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter1-ingestion-and-storage/section1-ingestion-kinesis): stream ingestion · Streaming data entry point · `part1-data-preparation/chapter1-ingestion-and-storage/section1-ingestion-kinesis`
- [S3 Storage](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter1-ingestion-and-storage/section2-storage-s3): object storage · Central durable storage and data lake layer · `part1-data-preparation/chapter1-ingestion-and-storage/section2-storage-s3`
- [EBS/EFS/FSx](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter1-ingestion-and-storage/section3-storage-ebs-efs-fsx): file storage · Mounted or shared storage options · `part1-data-preparation/chapter1-ingestion-and-storage/section3-storage-ebs-efs-fsx`
- [Transform](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter2-data-transformation): chapter · Data querying and wrangling stage · `part1-data-preparation/chapter2-data-transformation`
- [Querying](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter2-data-transformation/section1-querying): analysis · Data access and analytical querying · `part1-data-preparation/chapter2-data-transformation/section1-querying`
- [Wrangling](https://github.com/sunsikim/aws-mla-c01/tree/master/part1-data-preparation/chapter2-data-transformation/section2-wrangling): prep · Cleaning and feature shaping · `part1-data-preparation/chapter2-data-transformation/section2-wrangling`

### Part 2

Model preparation

- [Model Prep](https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation): learning path · From prepared data to trained models · `part2-model-preparation`
- [Managed Services](https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter1-aws-managed-services): AWS services · AWS-managed ML building blocks · `part2-model-preparation/chapter1-aws-managed-services`
- [Model Train](https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter2-model-training): chapter · Training concepts and SageMaker execution · `part2-model-preparation/chapter2-model-training`
- [Theories](https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter2-model-training/section1-modeling-theories): ML concepts · Foundational modeling concepts · `part2-model-preparation/chapter2-model-training/section1-modeling-theories`
- [SageMaker Train](https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter2-model-training/section2-sagemaker-training): managed training · AWS managed training workflow · `part2-model-preparation/chapter2-model-training/section2-sagemaker-training`
- [GenAI](https://github.com/sunsikim/aws-mla-c01/tree/master/part2-model-preparation/chapter3-generative-ai): modeling paradigm · Generative AI as a separate modeling track · `part2-model-preparation/chapter3-generative-ai`

### Part 3

Model deployment

- [Deployment](https://github.com/sunsikim/aws-mla-c01/tree/master/part3-model-deployment): learning path · Model serving and inference choices · `part3-model-deployment`
- [Docker EP](https://github.com/sunsikim/aws-mla-c01/tree/master/part3-model-deployment/chapter1-docker-endpoint): container endpoint · Self-managed container-based inference · `part3-model-deployment/chapter1-docker-endpoint`
- [SageMaker EP](https://github.com/sunsikim/aws-mla-c01/tree/master/part3-model-deployment/chapter2-sagemaker-endpoint): managed endpoint · AWS managed inference endpoint · `part3-model-deployment/chapter2-sagemaker-endpoint`

### Part 4

Pipeline management

- [Ops](https://github.com/sunsikim/aws-mla-c01/tree/master/part4-pipeline-management): learning path · Security and monitoring around the ML lifecycle · `part4-pipeline-management`
- [Security](https://github.com/sunsikim/aws-mla-c01/tree/master/part4-pipeline-management/chapter1-security): governance · Operational security boundaries · `part4-pipeline-management/chapter1-security`
- [Monitoring](https://github.com/sunsikim/aws-mla-c01/tree/master/part4-pipeline-management/chapter2-monitoring): observability · Runtime and pipeline monitoring · `part4-pipeline-management/chapter2-monitoring`

### Other components

- [Course Notes](https://github.com/sunsikim/aws-mla-c01/blob/master/README.md): documentation root · Repository overview for the AWS ML Associate learning path · `README.md`

## Connections

- Course Notes → Data Prep: covers · Repository is organized into the first learning path
- Course Notes → Model Prep: covers · Repository is organized into the second learning path
- Course Notes → Deployment: covers · Repository is organized into the third learning path
- Course Notes → Ops: covers · Repository is organized into the fourth learning path
- Data Prep → Ingest & Store: includes · Data preparation begins with ingestion and storage
- Data Prep → Transform: includes · Data preparation continues with transformation
- Ingest & Store → Kinesis Ingest: entry · Streaming ingestion boundary
- Ingest & Store → S3 Storage: stores · Durable object storage foundation
- Ingest & Store → EBS/EFS/FSx: stores · Mounted/shared storage alternatives
- Transform → Querying: splits into · Transformation starts with querying
- Transform → Wrangling: splits into · Transformation continues with wrangling
- S3 Storage → Querying: feeds · Stored data is queried for downstream prep
- S3 Storage → Wrangling: feeds · Stored data is wrangled for ML use
- Model Prep → Managed Services: includes · Managed AWS services introduce platform abstractions
- Model Prep → Model Train: includes · Model preparation centers on training
- Model Prep → GenAI: includes · Generative AI is treated as a separate track
- Model Train → Theories: grounds · Training is paired with conceptual modeling foundations
- Model Train → SageMaker Train: executes · SageMaker is the managed training boundary
- Wrangling → Model Train: inputs · Prepared data flows into model training
- SageMaker Train → SageMaker EP: deploys to · Managed training leads into managed serving
- Deployment → Docker EP: includes · Deployment offers a containerized path
- Deployment → SageMaker EP: includes · Deployment offers a managed AWS path
- Ops → Security: includes · Security is a cross-cutting operational concern
- Ops → Monitoring: includes · Monitoring is a cross-cutting operational concern
- Security → Monitoring: paired with · Operational governance and visibility work together
- Security → Data Prep: governs · Security wraps ingestion and storage
- Monitoring → Model Prep: observes · Monitoring spans preparation and training
- Monitoring → Deployment: observes · Monitoring spans deployment and inference
