# nvidia-isaac-ros/isaac_ros_cumotion architecture

> Architecture diagram of the GitHub repository nvidia-isaac-ros/isaac_ros_cumotion, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2025-01-20). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/nvidia-isaac-ros/isaac_ros_cumotion
- Repository: https://github.com/nvidia-isaac-ros/isaac_ros_cumotion

## Overview

##### Main Components

a. Core Components:
- cuMotion Core (CUDA-accelerated motion planning engine)
- MoveIt 2 Integration Layer
- Robot Control Interface
- Perception Pipeline (depth camera integration)
- Object Manipulation System

b. Supporting Components:
- Robot Description System
- Goal Setting System
- Visualization Tools
- Object Attachment System

##### Component Relationships and Data Flow

Layer 1 - User Interface:
**[RViz Visualization] <---> [MoveIt 2 Interface]**

Layer 2 - Planning and Control:
**[MoveIt 2 Plugin] <---> [cuMotion Planner] <---> [Robot Controller]**

Layer 3 - Perception and Environment:
**[Depth Cameras] --> [Robot Segmentation] --> [Environment Reconstruction]**

##### Key Technical Elements to Highlight

- ROS 2 Nodes and Topics (show message flow)
- Hardware Interfaces (robots, sensors)
- External Dependencies (nvblox, Isaac Sim)

##### Implementation Details

- Rectangles: Main processing nodes
- Hexagons: Hardware components
- Diamonds: Decision points

- Blue: Core cuMotion components
- Green: ROS 2/MoveIt integration
- Orange: Hardware interfaces
- Purple: CUDA-accelerated components
- Gray: External systems

##### Specific Features to Emphasize

- Motion Planning Pipeline:
- [Goal Setter] -> [Trajectory Planning] -> [Execution]
- Robot Segmentation Flow:
- [Depth Input] -> [Segmentation] -> [Filtered Output]
- Object Attachment System:
- [Object Detection] -> [Attachment Planning] -> [Execution]

##### Integration Points

Clear connections between:
- cuMotion and MoveIt 2
- Perception system and motion planning
- Simulation (Isaac Sim) and real hardware interfaces

## Diagram (Mermaid)

```mermaid
flowchart TB
    %% Styles and Classes
    classDef cuda fill:#9932CC,color:white
    classDef ros fill:#90EE90,color:black
    classDef hardware fill:#FFA500,color:black
    classDef core fill:#4169E1,color:white
    classDef interface fill:#A9A9A9,color:black

    %% Layer 1 - User Interface
    subgraph UI
        RViz[RViz Visualization]:::interface
        MoveItUI[MoveIt 2 Interface]:::ros
    end

    %% Layer 2 - Planning and Control
    subgraph Planning
        MoveItPlugin[MoveIt 2 Plugin]:::ros
        cuMotionCore[cuMotion Core]:::cuda
        RobotControl[Robot Controller]:::core
    end

    %% Layer 3 - Perception and Environment
    subgraph Perception
        DepthCam[Depth Cameras]:::hardware
        RobotSeg[Robot Segmentation]:::cuda
        EnvRecon[Environment Reconstruction]:::cuda
    end

    %% Object Manipulation System
    subgraph ObjectManip
        ObjDetect[Object Detection]:::core
        AttachPlanner[Attachment Planning]:::core
        AttachExec[Attachment Execution]:::core
    end

    %% Supporting Systems
    subgraph Support
        RobotDesc[Robot Description]:::interface
        GoalSetter[Goal Setting System]:::ros
        Visualizer[Visualization Tools]:::interface
    end

    %% Simulation Integration
    SimInt[Isaac Sim Integration]:::interface

    %% Relationships
    RViz <--> MoveItUI
    MoveItUI <--> MoveItPlugin
    MoveItPlugin <--> cuMotionCore
    cuMotionCore <--> RobotControl
    DepthCam --> RobotSeg
    RobotSeg --> EnvRecon
    EnvRecon --> cuMotionCore
    ObjDetect --> AttachPlanner
    AttachPlanner --> AttachExec
    AttachExec --> RobotControl
    GoalSetter --> MoveItPlugin
    RobotDesc --> MoveItPlugin
    Visualizer --> RViz
    SimInt <--> RobotControl

    %% Click Events
    click cuMotionCore "https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_cumotion/tree/main/curobo_core/curobo"
    click MoveItPlugin "https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_cumotion/tree/main/isaac_ros_cumotion_moveit/"
    click RobotSeg "https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_cumotion/blob/main/isaac_ros_cumotion/isaac_ros_cumotion/robot_segmenter.py"
    click AttachPlanner "https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_cumotion/tree/main/isaac_ros_cumotion_object_attachment/"
    click RobotDesc "https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_cumotion/tree/main/isaac_ros_cumotion_robot_description/"
    click GoalSetter "https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_cumotion/tree/main/isaac_ros_moveit_goal_setter/"
    click Visualizer "https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_cumotion/blob/main/isaac_ros_esdf_visualizer/isaac_ros_esdf_visualizer/esdf_visualizer.py"
    click SimInt "https://github.com/NVIDIA-ISAAC-ROS/isaac_ros_cumotion/blob/main/isaac_ros_cumotion_examples/isaac_sim_scripts/start_isaac_sim_franka.py"

    %% Legend
    subgraph Legend
        L1[CUDA-Accelerated]:::cuda
        L2[ROS 2 Components]:::ros
        L3[Hardware Interfaces]:::hardware
        L4[Core Components]:::core
        L5[Interface Components]:::interface
    end
```
