How apache/yunikorn-core works
Main Components
a) Core Components (Central Focus):
• Scheduler Core (pkg/scheduler)
• Resource Manager Proxy (pkg/rmproxy)
• Web Service (pkg/webservice)
• Event System (pkg/events)
b) Supporting Components:
• Configuration Management (pkg/common/configs)
• Security/ACL System (pkg/common/security)
• Metrics Collection (pkg/metrics)
• Plugin System (pkg/plugins)
┌─────────────────────────────────────────────────────┐
• External Systems │
• (Kubernetes, YARN, or other orchestrators) │
• ┤
• Resource Manager Proxy │
• ┤
• Scheduler Core │
• ┌─────────────┐ ┌──────────────┐ ┌──────────┐ │
• Placement │ │ Partition │ │ Objects │ │
• Engine │ │ Manager │ │ │ │
• ┘ └──────────────┘ └──────────┘ │
• ┤
• Events System │ Metrics System │
• ┤
• Web Service │
• ┘
Key Relationships to Highlight
a) Data Flow:
• External System → RM Proxy → Scheduler Core
• Scheduler Core → Events System
• Web Service ← All Components (for monitoring)
b) Component Interactions:
• How the placement engine interacts with nodes and applications
• Event flow through the system
• Metrics collection points
Important Details
a) Scheduler Core Internals:
• Placement Rules System
• Queue Management
• Application Management
• Node Management
• Resource Tracking
b) Supporting Features:
• Security/ACL System
• Configuration Management
• Plugin Architecture
• Health Checking System