How babitmf/bmf works
BMF is a cross-platform multimedia framework for building and running configurable media-processing graphs; BMFLite is its lightweight, client-side counterpart. The principal workflow is to define a graph through an API, configure modules and streams, schedule packet processing, and collect output. The repository also includes media codecs, GPU/data-conversion capabilities, and mobile algorithms and demos. Relationships below follow shown bindings, source references, or README statements; several runtime and mobile subsystems are represented at directory level because their implementation was not sampled.
Main entry points: py_engine.cpp Python Graph API · node.cpp Processing Node · graph.cpp Graph Runtime · input_stream_manager.cpp Input Scheduling
Components 22
Graph APIs
- Python Graph API
bmf/python/py_engine.cpp - Engine Connector
bmf/engine/connector/src/connector.cpp
Graph Runtime
- Graph Configuration
bmf/engine/c_engine/src/graph_config.cpp - Graph Runtime
bmf/engine/c_engine/src/graph.cpp - Module Factory
bmf/engine/c_engine/src/module_factory.cpp - Processing Node
bmf/engine/c_engine/src/node.cpp - Input Scheduling
bmf/engine/c_engine/src/input_stream_manager.cpp - Output Streams
bmf/engine/c_engine/src/output_stream_manager.cpp - Task Scheduler
bmf/engine/c_engine/src/scheduler.cpp
Media Processing
- Module SDK
bmf/sdk/cpp_sdk/src/module_manager.cpp - FFmpeg Modules
bmf/c_modules/src/ffmpeg_decoder.cpp - Heterogeneous Media
bmf/hmp/src/hmp_capi.cpp - GPU Filters
bmf/python_modules/rotate_gpu/rotate_gpu.py
BMFLite Clients
- BMFLite Algorithms
bmf_lite/src/algorithm/bmf_algorithm_impl.cpp - QNN ControlNet
bmf_lite/src/algorithm/contrib_modules/QnnControlNet/QnnControlNetPipeLine.cpp - Video Buffers
bmf_lite/src/media/video_buffer/hardware_device_context.cpp - Model Loader
bmf_lite/iOS/bmf_demo/bmf_demo/contrib_module/ml_stable_diffusion/common/pipeline/PipelineLoader.swift - Diffusion Pipeline
bmf_lite/iOS/bmf_demo/bmf_demo/contrib_module/ml_stable_diffusion/common/pipeline/Pipeline.swift - Image Playback
bmf_lite/android/app/src/main/java/com/bmf/lite/app/playctrl/ImagePlayerWrapper.java - Surface Renderer
bmf_lite/android/app/src/main/java/com/bmf/lite/app/render/GLSurfaceViewWrapper.java - Camera Capture
bmf_lite/ohos/entry/src/main/cpp/camera/camera_manager.cpp
Other components
- Developer
Connections 19
- Developer → Python Graph API: defines graph
README.md - Python Graph API → Engine Connector: binds to
bmf/python/py_engine.cpp - Python Graph API → Graph Configuration: accepts config
bmf/python/py_engine.cpp - Python Graph API → Graph Runtime: starts graph
- Graph Runtime → Graph Configuration: uses config
- Graph Runtime → Module Factory: creates modules
- Processing Node → Input Scheduling: uses inputs
- Input Scheduling → Processing Node: schedules task
bmf/engine/c_engine/src/input_stream_manager.cpp - Processing Node → Output Streams: publishes outputs
- Task Scheduler → Processing Node: dispatches work
- Module SDK → Developer: enables custom modules
README.md - Developer → FFmpeg Modules: configures transcode
README.md - Developer → GPU Filters: configures filters
README.md - Developer → Heterogeneous Media: uses conversions
README.md - Developer → BMFLite Algorithms: uses client framework
README.md - QNN ControlNet → Video Buffers: processes frames
- Model Loader → Diffusion Pipeline: loads pipeline
bmf_lite/iOS/bmf_demo/bmf_demo/contrib_module/ml_stable_diffusion/common/pipeline/PipelineLoader.swift - Image Playback → Surface Renderer: renders through
bmf_lite/android/app/src/main/java/com/bmf/lite/app/playctrl/ImagePlayerWrapper.java - Developer → Camera Capture: captures media