How xilinx/video-sdk works
Main Components
A. Application Layer
• FFmpeg Integration (from app-ffmpeg4-xma)
• GStreamer Integration (from video-sdk-gstreamer)
• Custom Applications (represented by various app-* directories)
B. Resource Management Layer
• XRM (Xilinx Resource Manager) component
• Job Slot Reservation System
C. Plugin Layer
• Decoder plugins (codec-decoder-xrm-plg-u30)
• Encoder plugins (codec-encoder-xrm-plg-u30)
• Scaler plugins (filter-scaler-xrm-plg-u30)
• Multiscaler plugins (filter-multiscaler-xma-plg-u30)
• Lookahead plugins (codec-lookahead-xma-plg)
D. Hardware Abstraction Layer
• XRT (Xilinx Runtime)
• XVBM (Xilinx Video Buffer Management)
• Container Runtime
E. Hardware Layer
• Alveo U30 Card
• Amazon EC2 VT1 instances
[Applications] (Top Layer)
• ↓
[Resource Management]
• ↓
[Plugins]
• ↓
[Hardware Abstraction]
• ↓
[Hardware] (Bottom Layer)
Key Relationships to Highlight
a. Data Flow:
• Video stream flow from input through decode→scale→encode
• Buffer management paths through XVBM
• Resource allocation requests through XRM
b. Control Flow:
• Application to XRM resource requests
• XRM to plugin initialization
• Plugin to XRT hardware access
Additional Elements
• Version information (SDK v3.0)
• Supported hardware platforms
• API boundaries