How rai-opensource/exploy works
Exploy exports reinforcement-learning environments and policies into ONNX graphs that include observation and action processing, then provides a C++ controller for deployment. The principal workflow is environment adaptation and graph export, followed by controller initialization, robot-state input collection, inference, and command output. The graph preserves both framework adapters and deployment interfaces. Several exporter and framework links are documented by the README or SOURCE INDEX; unsampled code is represented only where those references or the README support it.
Main entry points: controller.cpp ONNX Controller · context_manager.py Export Context · exportable_environment.py Exportable Environment · exporter.py ONNX Exporter
Components 26
Policy Export
- Exportable Environment
python/exploy/exporter/core/exportable_environment.py - Export Context
python/exploy/exporter/core/context_manager.py - Graph Components
python/exploy/exporter/core/components.py - Derived Tensors
python/exploy/exporter/core/derived_tensors.py - Tensor Proxy
python/exploy/exporter/core/tensor_proxy.py - Exportable Actor
python/exploy/exporter/core/actor.py - Policy Evaluator
python/exploy/exporter/core/evaluator.py - ONNX Session
python/exploy/exporter/core/session_wrapper.py - ONNX Exporter
python/exploy/exporter/core/exporter.py
Framework Adapters
- IsaacLab Adapter
python/exploy/exporter/frameworks/isaaclab/env.py - IsaacLab Inputs
python/exploy/exporter/frameworks/isaaclab/inputs.py - IsaacLab Entity Data
python/exploy/exporter/frameworks/isaaclab/articulation_data.py - MjLab Adapter
python/exploy/exporter/frameworks/mjlab/env.py - MjLab Inputs
python/exploy/exporter/frameworks/mjlab/inputs.py - MjLab Entity Data
python/exploy/exporter/frameworks/mjlab/entity_data.py
C++ Deployment
- ONNX Controller
control/src/controller.cpp - ONNX Runtime
control/src/onnx_runtime.cpp - Model Context
control/src/context.cpp - Tensor Matchers
control/src/matcher.cpp - Control Components
control/src/components.cpp - Execution Worker
control/src/worker.cpp
Robot Interfaces
- Robot State API
control/include/exploy/state_interface.hpp - Command API
control/include/exploy/command_interface.hpp - Data Collection API
control/include/exploy/data_collection_interface.hpp
Other components
- Robot Hardware
- ONNX Policy Model
Connections 29
- IsaacLab Adapter → Exportable Environment: adapts
- MjLab Adapter → Exportable Environment: adapts
python/exploy/exporter/frameworks/mjlab/env.py - IsaacLab Inputs → Export Context: registers inputs
python/exploy/exporter/frameworks/isaaclab/inputs.py - MjLab Inputs → Export Context: registers inputs
python/exploy/exporter/frameworks/mjlab/inputs.py - IsaacLab Entity Data → Tensor Proxy: uses tensors
python/exploy/exporter/frameworks/isaaclab/articulation_data.py - MjLab Entity Data → Tensor Proxy: uses tensors
python/exploy/exporter/frameworks/mjlab/entity_data.py - IsaacLab Adapter → Derived Tensors: uses
- MjLab Adapter → Derived Tensors: uses
python/exploy/exporter/frameworks/mjlab/env.py - Exportable Environment → Export Context: uses context
python/exploy/exporter/core/exportable_environment.py - Export Context → Graph Components: manages
python/exploy/exporter/core/context_manager.py - Policy Evaluator → Export Context: reads context
python/exploy/exporter/core/evaluator.py - Policy Evaluator → ONNX Session: runs inference
python/exploy/exporter/core/evaluator.py - ONNX Session → Exportable Actor: wraps actor
python/exploy/exporter/core/session_wrapper.py - ONNX Exporter → ONNX Policy Model: exports
- Exportable Environment → ONNX Exporter: exports graph
- ONNX Exporter → ONNX Policy Model: produces
- ONNX Policy Model → ONNX Controller: loads policy
- ONNX Controller → ONNX Runtime: initializes and evaluates
control/src/controller.cpp - ONNX Controller → Model Context: creates context
control/src/controller.cpp - Model Context → Tensor Matchers: matches tensors
- Model Context → Control Components: builds components
control/src/context.cpp - ONNX Controller → Execution Worker: sets callbacks
control/src/controller.cpp - Execution Worker → Robot State API: reads state
- Execution Worker → ONNX Controller: invokes callbacks
control/src/controller.cpp - Control Components → Robot State API: reads observations
- Control Components → Command API: writes commands
- ONNX Controller → Data Collection API: registers model data
control/src/controller.cpp - Robot Hardware → Robot State API: provides state
- Command API → Robot Hardware: dispatches commands