How isaac-sim/isaaclab works
Isaac Lab is a GPU-accelerated robotics simulation and learning framework built on Isaac Sim, with kit-less Newton workflows also supported. The principal workflow is to launch a training or evaluation script, step a configured environment, and use its observations and rewards to drive a learning framework. Environments coordinate scenes, physics, and task managers; separate subsystems provide sensors, control, teleoperation, imitation learning, and data tooling. The README establishes these major capabilities; arrows are limited to the environment lifecycle shown in sampled source and documented workflow relationships.
Main entry points: manager_based_env.py Environment API · physics_manager.py Physics manager · train.py RL train · simulation_context.py Simulation context
Components 25
Learning workflow
- RL train
scripts/reinforcement_learning/train.py - RL play
scripts/reinforcement_learning/play.py - Imitation scripts
scripts/imitation_learning - RL frameworks
Environments
- Environment API
source/isaaclab/isaaclab/envs/manager_based_env.py - RL and MARL envs
source/isaaclab/isaaclab/envs - Task managers
source/isaaclab/isaaclab/managers - MDP terms
source/isaaclab/isaaclab/envs/mdp
Simulation
- Interactive scene
source/isaaclab/isaaclab/scene/interactive_scene.py - Simulation context
source/isaaclab/isaaclab/sim/simulation_context.py - Physics manager
source/isaaclab/isaaclab/physics/physics_manager.py - PhysX backend
source/isaaclab_physx/isaaclab_physx/physics/physx_manager.py - Newton backend
source/isaaclab_newton/isaaclab_newton/physics/newton_manager.py - OVPhysX backend
source/isaaclab_ov/isaaclab_ov/physics/ovphysx_manager.py - Terrain generation
source/isaaclab/isaaclab/terrains
Robot interaction
- Sensors
source/isaaclab/isaaclab/sensors - Renderers
source/isaaclab/isaaclab/renderers - Controllers
source/isaaclab/isaaclab/controllers - Actuators
source/isaaclab/isaaclab/actuators - Teleoperation devices
source/isaaclab/isaaclab/devices
Data workflows
- Demo and dataset tools
scripts/tools - Mimic dataset workflow
scripts/imitation_learning/isaaclab_mimic - Locomanipulation data
scripts/imitation_learning/locomanipulation_sdg
Other components
- Researcher
- Isaac Sim
Connections 26
- Researcher → RL train: launches
- Researcher → RL play: launches
- Researcher → Imitation scripts: launches
- RL train → Environment API: steps environment
- RL play → Environment API: steps environment
- Imitation scripts → Environment API: uses environments
- RL train → RL frameworks: trains with
- Environment API → RL and MARL envs: provides
- Environment API → Interactive scene: creates scene
- Environment API → Simulation context: controls lifecycle
- Environment API → Task managers: coordinates
- Task managers → MDP terms: evaluates terms
- Simulation context → Physics manager: initializes
- Physics manager → PhysX backend: selects backend
- Physics manager → Newton backend: selects backend
- Physics manager → OVPhysX backend: selects backend
- Simulation context → Isaac Sim: runs on
- Interactive scene → Terrain generation: uses terrain
- Environment API → Sensors: renders and observes
- Sensors → Renderers: uses
- Environment API → Controllers: accepts control
- Controllers → Actuators: computes commands
- Teleoperation devices → Controllers: provides input
- Demo and dataset tools → Environment API: records or replays
- Mimic dataset workflow → Demo and dataset tools: processes demonstrations
- Locomanipulation data → Demo and dataset tools: generates datasets