How minho-fan/kernel-opt-agent works
Kernel Opt Agent packages four GPU-kernel skills. The main user workflow is to retrieve implementation evidence with kernel-KBS, iterate on a kernel with kernel-loop’s profiling-guided hypotheses, and measure the result with kernel-benchmark; kernel-profile also supports standalone checks and profiling. The corpus includes archived kernel implementations and PR artifacts. Links among the skills and their capabilities are based on README statements; the tree and excerpts do not show the unsampled benchmark or loop implementations in detail.
Main entry points: artifacts Evidence corpus · kernel-loop Optimization loop · ncu_profile.py Kernel profiling · kbs.py Knowledge search
Components 15
Optimization workflow
- Optimization loop
skills/kernel-loop
Kernel knowledge
- Knowledge search
skills/kernel-KBS/scripts/kbs.py
Correctness and performance
- Kernel benchmark
skills/kernel-benchmark - Kernel profiling
skills/kernel-profile/scripts/ncu_profile.py - Correctness check
skills/kernel-profile/scripts/correctness_check.py
Reference corpus
- Evidence corpus
skills/kernel-KBS/store/corpus/artifacts - CUTLASS PR artifacts
skills/kernel-KBS/store/corpus/artifacts/prs/cutlass - DeepGEMM PR artifacts
skills/kernel-KBS/store/corpus/artifacts/prs/deepgemm - FlashInfer PR artifacts
skills/kernel-KBS/store/corpus/artifacts/prs/flashinfer - PyTorch PR artifacts
skills/kernel-KBS/store/corpus/artifacts/prs/pytorch - SGLang PR artifacts
skills/kernel-KBS/store/corpus/artifacts/prs/sglang - vLLM PR artifacts
skills/kernel-KBS/store/corpus/artifacts/prs/vllm - Kernel examples
skills/kernel-KBS/store/corpus/artifacts/kernels
Other components
- Kernel engineer
- Reports and metrics
Connections 19
- Kernel engineer → Optimization loop: requests iterations
README.md - Kernel engineer → Knowledge search: searches evidence
README.md - Kernel engineer → Kernel benchmark: runs benchmarks
README.md - Kernel engineer → Kernel profiling: profiles kernels
README.md - Knowledge search → Evidence corpus: retrieves evidence
README.md - Evidence corpus → CUTLASS PR artifacts: includes PRs
README.md - Evidence corpus → DeepGEMM PR artifacts: includes PRs
README.md - Evidence corpus → FlashInfer PR artifacts: includes PRs
README.md - Evidence corpus → PyTorch PR artifacts: includes PRs
README.md - Evidence corpus → SGLang PR artifacts: includes PRs
README.md - Evidence corpus → vLLM PR artifacts: includes PRs
README.md - Evidence corpus → Kernel examples: includes kernels
README.md - Optimization loop → Kernel profiling: orchestrates profiling
README.md - Optimization loop → Knowledge search: uses guidance
README.md - Optimization loop → Kernel benchmark: runs final benchmark
README.md - Kernel profiling → Correctness check: checks correctness
README.md - Kernel benchmark → Reports and metrics: writes benchmark report
README.md - Kernel profiling → Reports and metrics: writes profiling artifacts
README.md - Optimization loop → Reports and metrics: writes final report
README.md