# oracle-quickstart/oci-ai-blueprints architecture

> Architecture diagram of the GitHub repository oracle-quickstart/oci-ai-blueprints, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-05-11). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/oracle-quickstart/oci-ai-blueprints
- Repository: https://github.com/oracle-quickstart/oci-ai-blueprints

## Overview

##### Project type and purpose
- This is an Infrastructure-as-Code project built with Terraform.
- It provisions an Oracle Cloud Infrastructure (OCI) container platform (OKE) and then installs the “OCI AI Blueprints” platform on top of it—providing a no-code, opinionated solution for deploying and managing Generative AI workloads (inference, fine-tuning, autoscaling, multi-node, MIG, RDMA, etc.).

##### File structure
- Top-level directories:
- cluster_creation_terraform – Terraform code to provision a fresh OKE cluster (networking, security lists, data sources, variables, providers).
- oci_ai_blueprints_terraform – Terraform code to install the AI Blueprints platform (app-api, app-background workers, portal UI, config maps, database, ingress, RBAC, Helm chart for LWS CRDs, Corrino modules for cluster tools).
- docs & sample_blueprints – User docs and example blueprint JSON configurations.
- Patterns:
– A clear two-layer IaC architecture (cluster provisioning vs. platform deployment).
– Module-based Terraform (e.g. corrino modules for cluster-tools, networking, policies, vault).
– Kubernetes artifacts managed via Helm (lws Chart) and Terraform Kubernetes provider.
- Ancillary files: README, LICENSE, RELEASE_NOTES, version files.

##### Extract insights from the README
- Confirms the two-stage install: “Install AI Blueprints to an OKE cluster” then “Deploy Blueprints” (inference, fine-tuning, autoscaling, etc.).
- Lists key services: UI portal, API, background workers, monitoring, logging, auto-scaling.

##### Elements
- Terraform → OCI (resource creation)
- Terraform → Kubernetes (manifests & Helm)
- User → Portal/API → database & job queue
- API → LWS CRD → Inference Pods
- KEDA → Pod scaling
- Pods → Object Storage (model access)
- Prometheus → Pods & services → Grafana/Jaeger
- Infrastructure (blue)
- Kubernetes control plane & nodes (green)
- Microservices (orange)
- Data stores (purple)
- Observability (teal)

## Diagram (Mermaid)

```mermaid
flowchart TB
    %% Layer 1: Infrastructure Provisioning
    subgraph "Infrastructure Provisioning" 
        direction TB
        CT("Cluster Creation Terraform"):::infra
        AB("AI Blueprints Terraform"):::infra
        CT -->|"uses OCI Provider"| OCI_API["OCI Cloud Provider"]:::cloud
        AB -->|"uses OCI + K8S Providers"| OCI_API
    end

    click CT "https://github.com/oracle-quickstart/oci-ai-blueprints/tree/main/cluster_creation_terraform/"
    click AB "https://github.com/oracle-quickstart/oci-ai-blueprints/tree/main/oci_ai_blueprints_terraform/"
    click OCI_API "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/cluster_creation_terraform/providers.tf"

    %% OCI Cloud Resources
    subgraph "OCI Resources" 
        direction TB
        VCN("VCN & Networking"):::cloud
        SEC("Security Lists"):::cloud
        CLUSTER("OKE Cluster"):::cloud
        DB("Database Service"):::cloud
        OBJ("Object Storage"):::cloud
        IAM("IAM & KMS"):::cloud
    end

    click VCN "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/cluster_creation_terraform/oke-network.tf"
    click SEC "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/cluster_creation_terraform/oke-security-lists.tf"
    click CLUSTER "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/cluster_creation_terraform/oke.tf"
    click DB "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/database.tf"
    click OBJ "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/data.tf"
    click IAM "https://github.com/oracle-quickstart/oci-ai-blueprints/tree/main/oci_ai_blueprints_terraform/modules/corrino/modules/oci-vault-kms/"

    OCI_API -->|“OCI API”| VCN
    OCI_API -->|“OCI API”| SEC
    OCI_API -->|“OCI API”| CLUSTER
    OCI_API -->|“OCI API”| DB
    OCI_API -->|“OCI API”| OBJ
    OCI_API -->|“OCI API”| IAM

    %% Layer 2: Kubernetes Runtime Platform
    CLUSTER -->|"Kube API" | K8S["OKE Kubernetes Cluster"]:::k8s

    subgraph "OKE Kubernetes Cluster" 
        direction TB
        subgraph "Control Plane" 
            direction TB
            CP["K8s Control Plane"]:::k8s
        end

        subgraph "Node Pools" 
            direction TB
            GPU["GPU Pool"]:::k8s
            CPU["CPU Pool"]:::k8s
            RDMA["RDMA/MIG Pool"]:::k8s
        end
    end

    click K8S "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/cluster_creation_terraform/oke.tf"

    %% Deploy Platform Services
    AB -->|"kube-API"| UI["Portal UI Service"]:::micro
    AB -->|"kube-API"| API["API Service"]:::micro
    AB -->|"kube-API"| BG["Background Worker"]:::micro
    AB -->|"kube-API"| CM["ConfigMaps & Secrets"]:::micro
    AB -->|"kube-API"| ING["Ingress-NGINX"]:::micro
    AB -->|"kube-API"| RBAC["RBAC"]:::micro
    AB -->|"Helm"| LWS_CHART["LWS CRD & Controller"]:::micro

    click UI "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/app-blueprint-portal.tf"
    click API "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/app-api.tf"
    click BG "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/app-background.tf"
    click CM "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/app-configmap.tf"
    click ING "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/ingress.tf"
    click RBAC "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/rbac.tf"
    click LWS_CHART "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/helm.tf"
    click LWS_CHART "https://github.com/oracle-quickstart/oci-ai-blueprints/tree/main/oci_ai_blueprints_terraform/lws/"

    %% Data Stores
    subgraph "Data Layer" 
        direction TB
        Postgres["Postgres DB"]:::data
        Redis["Redis Cache"]:::data
        Storage["OCI Object Storage"]:::data
    end

    %% Observability
    subgraph "Observability" 
        direction TB
        Prom["Prometheus"]:::obs
        Graf["Grafana"]:::obs
        Jaeg["Jaeger"]:::obs
        MS["metrics-server"]:::obs
        KEDA["KEDA Autopilot"]:::obs
    end

    click Redis "https://github.com/oracle-quickstart/oci-ai-blueprints/blob/main/oci_ai_blueprints_terraform/modules/corrino/modules/cluster-tools/redis.tf"
    click MS "https://github.com/oracle-quickstart/oci-ai-blueprints/tree/main/oci_ai_blueprints_terraform/modules/corrino/modules/cluster-tools/"
    click Graf "https://github.com/oracle-quickstart/oci-ai-blueprints/tree/main/oci_ai_blueprints_terraform/modules/corrino/modules/cluster-tools/"
    click Jaeg "https://github.com/oracle-quickstart/oci-ai-blueprints/tree/main/oci_ai_blueprints_terraform/modules/corrino/modules/cluster-tools/"
    click Prom "https://github.com/oracle-quickstart/oci-ai-blueprints/tree/main/oci_ai_blueprints_terraform/modules/corrino/modules/cluster-tools/"

    %% User Interaction
    User("User (CLI/Portal)"):::external
    User -->|HTTP/REST| UI
    UI -->|HTTP/REST| API
    API -->|SQL| Postgres
    API -->|enqueue| Redis
    BG -->|dequeue| Redis
    BG -->|uses CRD API| LWS_CHART

    %% Inference Scheduling
    API -->|"CRD Create"| LWS_CHART
    LWS_CHART -->|"schedules"| GPU
    LWS_CHART -->|"schedules"| RDMA

    %% Scaling
    MS -->|"metrics"| KEDA
    KEDA -->|"scale"| GPU
    KEDA -->|"scale"| CPU
    KEDA -->|"scale"| RDMA

    %% Storage Access
    GPU -->|"mount"| Storage
    CPU -->|"mount"| Storage
    RDMA -->|"mount"| Storage
    CM -->|"config"| GPU
    CM -->|"config"| CPU
    CM -->|"config"| RDMA

    %% Observability Flows
    Prom -->|"scrape"| UI
    Prom -->|"scrape"| API
    Prom -->|"scrape"| BG
    Prom -->|"scrape"| GPU
    Graf -->|"visualize"| Prom
    Jaeg -->|"trace"| API
    Jaeg -->|"trace"| BG

    %% Styles
    classDef infra fill:#D0E7FF,stroke:#0366D6
    classDef cloud fill:#E3F2FD,stroke:#90CAF9
    classDef k8s fill:#E8F5E9,stroke:#43A047
    classDef micro fill:#FFF3E0,stroke:#FB8C00
    classDef data fill:#F3E5F5,stroke:#8E24AA
    classDef obs fill:#E0F7FA,stroke:#00ACC1
    classDef external fill:#FFFFFF,stroke:#000000,stroke-dasharray: 2 2
```
