How paragao/nixl-deepepv2-aws-efa-microbenchmarks works
This repository packages a GPU-communication benchmark image and manifests for validating NCCL, DeepEP V2, and NIXL over AWS EFA. The main workflow is to build and publish the image, configure the manifests, then run the three two-node suites; NIXL starts its target before its initiator. A separate optional publishing check converts an SBOM to TSV and evaluates it against a license policy. Relationships among these stages follow the README; unsampled manifest and container internals are represented at their existing paths rather than inferred.
Main entry points: nixl-lf-initiator-validate.yaml NIXL initiator · nixl-lf-target-validate.yaml NIXL target · Dockerfile GPU container · nccl NCCL collectives
Components 15
Image recipe
- GPU container
awslabs-contrib/architectures/containers/deepv2-nixl-efa/Dockerfile
Benchmark suites
- NCCL collectives
benchmarks/nccl - DeepEP V2
benchmarks/deepep - NIXL target
benchmarks/nixl/nixl-lf-target-validate.yaml - NIXL initiator
benchmarks/nixl/nixl-lf-initiator-validate.yaml - NIXL test scripts
benchmarks/nixl/nixl_lf_test.py - EFA version probe
benchmarks/efa
License gate
- SBOM TSV emitter
awslabs-contrib/architectures/containers/deepv2-nixl-efa/sbom_emit.py - License checker
awslabs-contrib/architectures/containers/deepv2-nixl-efa/check_licenses.py - License policy
awslabs-contrib/architectures/containers/deepv2-nixl-efa/validation-gate.yaml
Configuration
- Environment values
env.example.sh
Other components
- Engineer
- Image registry
- EKS cluster
- SBOM source
Connections 17
- Engineer → GPU container: builds
README.md - GPU container → Image registry: pushes image
README.md - Engineer → Environment values: configures
README.md - Engineer → NCCL collectives: applies manifests
README.md - Engineer → DeepEP V2: applies manifests
README.md - Engineer → NIXL target: starts first
README.md - Engineer → NIXL initiator: starts second
README.md - Engineer → EFA version probe: runs probe
README.md - NCCL collectives → EKS cluster: runs on
README.md - DeepEP V2 → EKS cluster: runs on
README.md - NIXL target → EKS cluster: runs on
README.md - NIXL initiator → EKS cluster: runs on
README.md - NIXL target → NIXL initiator: provides target IP
README.md - NIXL initiator → NIXL test scripts: runs tests
README.md - SBOM source → SBOM TSV emitter: provides JSON
README.md - SBOM TSV emitter → License checker: emits TSV
README.md - License checker → License policy: checks against
README.md