How orcahand/rwr_system works
• Experiments & Launchers: This module (under the “experiments” directory) contains various launch files and experiment scripts (e.g., teleop control, rosbag record, accuracy tests). Represent it as the primary “Experiment/Launch Controller”.
• Ingress: Under “src/ingress”, there are modules for handling sensor inputs from different sources:
• OAK-D (camera streams) and its related configuration.
• Rokoko sensors for glove input.
• Additional sensing through webcams or paper experiments.
Under a single “Ingress” or “Sensor Data Acquisition” component.
• Hand Control: In “src/hand_control”, which includes calibration, dynamixel client, kinematics, and node files. This module is the backbone for interfacing with the robot hand – labeling it as “Hand Control & Kinematics”.
• Retargeter: Found in “src/retargeter”, where the retargeting algorithms lie. It subscribes to sensor data (e.g., glove keypoints from ingress) and publishes hand control commands. Label it “Retargeter/Mapping Logic”.
• Logger: The “src/logger” package logs data and sensor streams. Represent this component as “Data Logger/Recorder”.
• Visualization (Viz): Under “src/viz”, this area handles visualization routines (both via Rviz and rosbag-related visualizers). Label it “Visualization & RViz Integration”.
• Processing (if applicable): Although not the central pipeline, the “src/processing” package likely handles post-process analysis of recorded data.
Data Flow and Interactions
• Hand Control to the Visualization module, so that commands and joint states are sent for real-time visual feedback in Rviz.
• Additionally, demonstrate how Experiment Launchers are used to initialize these nodes (launching groups of nodes typically together).
Architectural Patterns & Technologies
• Use ROS 2 as the backbone architecture. Emphasize that nodes publish/subscribe on topics (for example, RokokoNode publishes on /ingress/mano, RetargeterNode subscribes to it and publishes on /hand/policy_output).
• That the project leverages a modular package design. This encourages separation of concerns – sensor ingestion, control logic, and visualization are in dedicated packages.
• Mention that some packages (like hand_control) are built using both Python and CMake, indicated by the CMakeLists.txt files.
• Use of roslaunch files (both for experiments and dedicated package nodes) and ROS topic-centric design.
Final Touches
• Utilize annotations to include critical information such as ROS topics and key launch files (e.g., retargeting_rviz_orca.launch.py, run_teleop_rokoko.launch.py).