# paragao/nixl-deepepv2-aws-efa-microbenchmarks architecture

> Architecture diagram of the GitHub repository paragao/nixl-deepepv2-aws-efa-microbenchmarks, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-18). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks
- Repository: https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks

## Overview

This repository packages a GPU-communication benchmark image and manifests for validating NCCL, DeepEP V2, and NIXL over AWS EFA. The main workflow is to build and publish the image, configure the manifests, then run the three two-node suites; NIXL starts its target before its initiator. A separate optional publishing check converts an SBOM to TSV and evaluates it against a license policy. Relationships among these stages follow the README; unsampled manifest and container internals are represented at their existing paths rather than inferred.

Main entry points: [`benchmarks/nixl/nixl-lf-initiator-validate.yaml`](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/benchmarks/nixl/nixl-lf-initiator-validate.yaml) (NIXL initiator), [`benchmarks/nixl/nixl-lf-target-validate.yaml`](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/benchmarks/nixl/nixl-lf-target-validate.yaml) (NIXL target), [`awslabs-contrib/architectures/containers/deepv2-nixl-efa/Dockerfile`](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/awslabs-contrib/architectures/containers/deepv2-nixl-efa/Dockerfile) (GPU container), [`benchmarks/nccl`](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/tree/main/benchmarks/nccl) (NCCL collectives)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_image["Image recipe"]
  node_container["GPU container"]
end

subgraph group_bench["Benchmark suites"]
  node_nccl["NCCL collectives"]
  node_deepep["DeepEP V2"]
  node_nixl_target["NIXL target"]
  node_nixl_initiator["NIXL initiator"]
  node_nixl_scripts["NIXL test scripts<br/>[nixl_lf_test.py]"]
  node_efa_probe["EFA version probe"]
end

subgraph group_license["License gate"]
  node_sbom_emit["SBOM TSV emitter<br/>[sbom_emit.py]"]
  node_license_check["License checker<br/>[check_licenses.py]"]
  node_policy["License policy"]
end

subgraph group_config["Configuration"]
  node_env["Environment values<br/>[env.example.sh]"]
end

node_operator(("Engineer"))
node_registry[("Image registry")]
node_cluster["EKS cluster"]
node_sbom["SBOM source"]

node_operator -->|"builds"| node_container
node_container -->|"pushes image"| node_registry
node_operator -->|"configures"| node_env
node_operator -->|"applies manifests"| node_nccl
node_operator -->|"applies manifests"| node_deepep
node_operator -->|"starts first"| node_nixl_target
node_operator -->|"starts second"| node_nixl_initiator
node_operator -->|"runs probe"| node_efa_probe
node_nccl -->|"runs on"| node_cluster
node_deepep -->|"runs on"| node_cluster
node_nixl_target -->|"runs on"| node_cluster
node_nixl_initiator -->|"runs on"| node_cluster
node_nixl_target -->|"provides target IP"| node_nixl_initiator
node_nixl_initiator -->|"runs tests"| node_nixl_scripts
node_sbom -->|"provides JSON"| node_sbom_emit
node_sbom_emit -->|"emits TSV"| node_license_check
node_license_check -->|"checks against"| node_policy

click node_container "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/awslabs-contrib/architectures/containers/deepv2-nixl-efa/Dockerfile"
click node_nccl "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/tree/main/benchmarks/nccl"
click node_deepep "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/tree/main/benchmarks/deepep"
click node_nixl_target "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/benchmarks/nixl/nixl-lf-target-validate.yaml"
click node_nixl_initiator "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/benchmarks/nixl/nixl-lf-initiator-validate.yaml"
click node_nixl_scripts "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/benchmarks/nixl/nixl_lf_test.py"
click node_efa_probe "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/tree/main/benchmarks/efa"
click node_env "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/env.example.sh"
click node_sbom_emit "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/awslabs-contrib/architectures/containers/deepv2-nixl-efa/sbom_emit.py"
click node_license_check "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/awslabs-contrib/architectures/containers/deepv2-nixl-efa/check_licenses.py"
click node_policy "https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/awslabs-contrib/architectures/containers/deepv2-nixl-efa/validation-gate.yaml"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_container toneBlue
class node_nccl,node_deepep,node_nixl_target,node_nixl_initiator,node_nixl_scripts,node_efa_probe,node_registry toneAmber
class node_sbom_emit,node_license_check,node_policy toneMint
class node_env toneRose
class node_operator,node_cluster,node_sbom toneIndigo
```

## Components

### Image recipe

- [GPU container](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/awslabs-contrib/architectures/containers/deepv2-nixl-efa/Dockerfile): `awslabs-contrib/architectures/containers/deepv2-nixl-efa/Dockerfile`

### Benchmark suites

- [NCCL collectives](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/tree/main/benchmarks/nccl): `benchmarks/nccl`
- [DeepEP V2](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/tree/main/benchmarks/deepep): `benchmarks/deepep`
- [NIXL target](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/benchmarks/nixl/nixl-lf-target-validate.yaml): `benchmarks/nixl/nixl-lf-target-validate.yaml`
- [NIXL initiator](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/benchmarks/nixl/nixl-lf-initiator-validate.yaml): `benchmarks/nixl/nixl-lf-initiator-validate.yaml`
- [NIXL test scripts](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/benchmarks/nixl/nixl_lf_test.py): `benchmarks/nixl/nixl_lf_test.py`
- [EFA version probe](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/tree/main/benchmarks/efa): `benchmarks/efa`

### License gate

- [SBOM TSV emitter](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/awslabs-contrib/architectures/containers/deepv2-nixl-efa/sbom_emit.py): `awslabs-contrib/architectures/containers/deepv2-nixl-efa/sbom_emit.py`
- [License checker](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/awslabs-contrib/architectures/containers/deepv2-nixl-efa/check_licenses.py): `awslabs-contrib/architectures/containers/deepv2-nixl-efa/check_licenses.py`
- [License policy](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/awslabs-contrib/architectures/containers/deepv2-nixl-efa/validation-gate.yaml): `awslabs-contrib/architectures/containers/deepv2-nixl-efa/validation-gate.yaml`

### Configuration

- [Environment values](https://github.com/paragao/nixl-deepepv2-aws-efa-microbenchmarks/blob/main/env.example.sh): `env.example.sh`

### Other components

- **Engineer**
- **Image registry**
- **EKS cluster**
- **SBOM source**

## Connections

- Engineer → GPU container: builds (evidence: `README.md`)
- GPU container → Image registry: pushes image (evidence: `README.md`)
- Engineer → Environment values: configures (evidence: `README.md`)
- Engineer → NCCL collectives: applies manifests (evidence: `README.md`)
- Engineer → DeepEP V2: applies manifests (evidence: `README.md`)
- Engineer → NIXL target: starts first (evidence: `README.md`)
- Engineer → NIXL initiator: starts second (evidence: `README.md`)
- Engineer → EFA version probe: runs probe (evidence: `README.md`)
- NCCL collectives → EKS cluster: runs on (evidence: `README.md`)
- DeepEP V2 → EKS cluster: runs on (evidence: `README.md`)
- NIXL target → EKS cluster: runs on (evidence: `README.md`)
- NIXL initiator → EKS cluster: runs on (evidence: `README.md`)
- NIXL target → NIXL initiator: provides target IP (evidence: `README.md`)
- NIXL initiator → NIXL test scripts: runs tests (evidence: `README.md`)
- SBOM source → SBOM TSV emitter: provides JSON (evidence: `README.md`)
- SBOM TSV emitter → License checker: emits TSV (evidence: `README.md`)
- License checker → License policy: checks against (evidence: `README.md`)
