# dgaliata/the-magnolia-project architecture

> Architecture diagram of the GitHub repository dgaliata/the-magnolia-project, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-05-21). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/dgaliata/the-magnolia-project
- Repository: https://github.com/dgaliata/the-magnolia-project

## Overview

##### Project Type and Purpose
- The Magnolia Project is a full-stack, cloud-native infrastructure-as-code (IaC) deployment combined with multiple FastAPI-based applications, CI/CD pipelines, security controls, and monitoring.
- Purpose: Automate and secure the deployment of a biomedical company’s web apps (Employee Directory, Scientific Data Management, Authentication Service) on AWS, with DynamoDB/S3 storage, Prometheus/Grafana monitoring, and GitHub Actions pipelines.

##### File Structure
- Top-level: README.md, Terraform folder, GitHub workflows, .gitignore
- terraform/environments: separate state (dev, production)
- terraform/modules: reusable building blocks for compute, database, load_balancing, monitoring, security, storage, vpc
- terraform/provider.tf: AWS provider configuration
- CI/CD: .github/workflows/trivy_tf_scan.yml triggers security scans on Terraform code

##### Extract Architectural Insights from the README
- AWS Components: VPC, subnets, EC2, security groups, IAM roles, DynamoDB tables, S3 buckets
- FastAPI Apps: served on EC2 (or containerized), backed by DynamoDB/S3, template rendering via Jinja2
- CI/CD: GitHub Actions for Terraform plan/apply and FastAPI build/deploy, with integrated security checks (Trivy, Terraform security scans)
- Monitoring & Logging: Prometheus (metrics exporter on apps & infra), Grafana dashboards, CloudWatch, CloudTrail, GuardDuty, AWS SNS alerts

##### Main Components & Their Interactions
a. GitHub Actions Pipeline
- Stages: lint/format → security scans (Trivy, tfsec) → Terraform plan/apply → FastAPI application build & deploy
- Artifacts flow into AWS CodeDeploy (or custom deployments)
b. Terraform IaC
- Orchestrates all AWS resources via modules
- Modules enforce separation of concerns (networking, security, compute, storage, monitoring)
c. AWS Networking & Security
- VPC module: public/private subnets, routing tables, NAT
- Security module: security groups, NACLs, IAM roles/policies
d. Compute & Load Balancing
- Compute module: EC2 Auto Scaling Group or ECS/EKS cluster for FastAPI services & monitoring agents
- Load Balancing module: Application Load Balancer distributing traffic to FastAPI instances
e. Data Storage
- Database module: DynamoDB tables for application data (employees, experiments)
- Storage module: S3 buckets for experiment assets, lifecycle policies to Glacier
f. Monitoring & Alerting
- Monitoring module: EC2 instances or sidecar containers running Prometheus exporters
- Grafana (deployed on EC2 or Grafana Cloud) visualizing metrics from Prometheus and AWS CloudWatch
- Alerting through AWS SNS, GuardDuty events, CloudWatch alarms

##### Architectural Patterns & Design Principles
- Infrastructure-as-Code: Terraform modules promote DRY, versioned, environment-specific deployments
- Microservices/SOA: Each FastAPI app is logically separated (Employee, Scientific Data, Auth) but co-hosted on shared compute resources
- Security-First: Principle of least privilege via IAM roles, encrypted-at-rest data stores, CI/CD security scans
- Observability: Metrics (Prometheus), logs (CloudWatch, CloudTrail), dashboards (Grafana), alerts (SNS, GuardDuty)

## Diagram (Mermaid)

```mermaid
flowchart TB
    %% CI/CD Layer
    subgraph "CI/CD Layer"
        GA["GitHub Actions Pipeline"]:::ci_cd
    end

    %% IaC Layer
    subgraph "IaC Layer"
        TL[".terraform.lock.hcl"]:::iac
        Prov["Terraform Provider (provider.tf)"]:::iac
        subgraph "Environments"
            DEV["Dev Environment"]:::iac
            PROD["Prod Environment"]:::iac
        end
        subgraph "Terraform Modules"
            VPC["VPC Module"]:::network
            SEC["Security Module"]:::network
            COMP_M["Compute Module"]:::compute
            LB_M["Load Balancer Module"]:::compute
            DB_M["Database Module"]:::data
            ST_M["Storage Module"]:::data
            MON_M["Monitoring Module"]:::monitoring
        end
    end

    %% AWS Infrastructure
    subgraph "AWS Infrastructure"
        subgraph "Networking & Security"
            VPCR["VPC"]:::network
            SG["Security Groups & NACLs"]:::network
        end
        subgraph "Compute & Application"
            ALB["Application Load Balancer"]:::compute
            subgraph "FastAPI Services"
                FE["Employee Directory"]:::compute
                FS["Scientific Data Service"]:::compute
                FA["Auth Service"]:::compute
            end
        end
        subgraph "Data Storage"
            DB["DynamoDB Tables"]:::data
            S3["S3 Buckets"]:::data
        end
        subgraph "Monitoring & Logging"
            Prom["Prometheus"]:::monitoring
            Graf["Grafana"]:::monitoring
            CW["CloudWatch/CloudTrail"]:::monitoring
            GD["GuardDuty"]:::monitoring
            SNS["SNS Alerts"]:::monitoring
        end
    end

    %% Connections
    GA -->|"triggers IaC pipeline"| Prov
    GA -->|uses environments| DEV
    GA -->|uses environments| PROD

    Prov -->|"configures"| VPCR
    Prov -->|"configures"| SG
    VPC -->|"defines"| VPCR
    SEC -->|"defines"| SG
    COMP_M -->|"provisions"| ALB
    COMP_M -->|"provisions"| FE
    COMP_M -->|"provisions"| FS
    COMP_M -->|"provisions"| FA
    LB_M -->|"configures"| ALB
    DB_M -->|"creates"| DB
    ST_M -->|"creates"| S3
    MON_M -->|"sets up"| Prom
    MON_M -->|"sets up"| CW

    ALB -->|"HTTPS request"| FE
    ALB -->|"HTTPS request"| FS
    ALB -->|"HTTPS request"| FA

    FE -->|"reads/writes"| DB
    FS -->|"reads/writes"| DB
    FA -->|"reads/writes"| DB
    FE -->|"stores assets"| S3
    FS -->|"stores assets"| S3

    FE -->|"metrics export"| Prom
    FS -->|"metrics export"| Prom
    FA -->|"metrics export"| Prom
    Prom -->|"visualizes"| Graf

    FE -->|"logs/events"| CW
    FS -->|"logs/events"| CW
    FA -->|"logs/events"| CW
    CW -->|"feeds"| GD
    GD -->|"alerts via"| SNS

    %% Click Events
    click GA "https://github.com/dgaliata/the-magnolia-project/blob/main/.github/workflows/trivy_tf_scan.yml"
    click Prov "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/provider.tf"
    click DEV "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/environments/dev/main.tf"
    click PROD "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/environments/production/main.tf"
    click VPC "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/modules/vpc/main.tf"
    click SEC "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/modules/security/main.tf"
    click COMP_M "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/modules/compute/main.tf"
    click LB_M "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/modules/load_balancing/main.tf"
    click DB_M "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/modules/database/main.tf"
    click ST_M "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/modules/storage/main.tf"
    click MON_M "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/modules/monitoring/main.tf"
    click TL "https://github.com/dgaliata/the-magnolia-project/blob/main/terraform/.terraform.lock.hcl"
    click README "https://github.com/dgaliata/the-magnolia-project/blob/main/README.md"

    %% Styles
    classDef ci_cd fill:#cccccc,stroke:#333,stroke-width:1px
    classDef iac fill:#dddddd,stroke:#333,stroke-width:1px
    classDef network fill:#ffcc99,stroke:#333,stroke-width:1px
    classDef compute fill:#99ccff,stroke:#333,stroke-width:1px
    classDef data fill:#99ff99,stroke:#333,stroke-width:1px
    classDef monitoring fill:#cc99ff,stroke:#333,stroke-width:1px
```
