vllm-project/aibrix

AIBrix is cloud-native infrastructure for deploying, routing, and scaling LLM inference. A principal operator workflow is to submit a deployment through the console, have the control plane plan and provision resources, and expose a running model for inference. The runtime also includes autoscaling, model-adapter management, standardized engine metrics, batch dispatch, and distributed KV-cache capabilities. The graph combines README-documented capabilities with the sampled controller, batch, metrics, and runtime source; several broader subsystems are represented at their existing directory paths because their implementation was not sampled.