How labsir-un/trayectorias_seguras_robotica_colaborativa works
This ROS 2 system supports supervised collaborative-robot operation: camera perception estimates operator condition and robot–operator proximity; control components make reactive decisions and coordinate motion; a socket bridge connects ROS commands and robot state to the ABB controller. Metrics record safety and motion outcomes. The README also documents MoveIt configuration and an ABB RobotStudio station. Several package interactions are described only at package level, so those links are marked unverified; unsampled source is not assumed to establish calls.
Main entry points: operator_fatigue.py Fatigue ROS node · control_decision.cpp Reactive decisions · robot_operator_interaction.py Spatial interaction node · socket.cpp ABB socket bridge
Components 27
Operator perception
- RGB camera node
colab_supervision_operator/colab_supervision_operator/nodes/camera.py - Fatigue ROS node
colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py - Face landmarks
colab_supervision_operator/colab_supervision_operator/perception/face_landmark_detector.py - Person detector
colab_supervision_operator/colab_supervision_operator/perception/person_detector.py - Person tracker
colab_supervision_operator/colab_supervision_operator/perception/person_tracker.py - Head pose
colab_supervision_operator/colab_supervision_operator/perception/head_pose_estimator.py - Attention analysis
colab_supervision_operator/colab_supervision_operator/perception/attention_analyzer.py - Blink analysis
colab_supervision_operator/colab_supervision_operator/perception/blink_analyzer.py - Expression analysis
colab_supervision_operator/colab_supervision_operator/perception/expression_analyzer.py - Fatigue analysis
colab_supervision_operator/colab_supervision_operator/perception/fatigue_analyzer.py - Spatial interaction node
colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py - Depth person detector
colab_supervision_operator/colab_supervision_operator/perception/depth_person_detector.py - Robot detector
colab_supervision_operator/colab_supervision_operator/perception/robot_detector.py - Collision estimator
colab_supervision_operator/colab_supervision_operator/perception/collision_estimator.py
Safety supervision
- Operator condition
colab_supervision_control/src/operator_condition.cpp - Control supervisor
colab_supervision_control/src/control_supervisor.cpp - Command validator
colab_supervision_control/src/command_validator.cpp - Reactive decisions
colab_supervision_control/src/control_decision.cpp
Robot motion
- MoveIt commander
colab_supervision_commander/src/commander_template.cpp - MoveIt configuration
colab_supervision_moveit_config/launch/move_group.launch.py - ABB socket bridge
colab_supervision_abb_brige/src/socket.cpp - TCP pose parser
colab_supervision_abb_brige/src/tcp_pose_parser.cpp - RobotStudio station
abb_robotstudio/pack_and_go/socket_ver.py
Metrics
- Experimental metrics
colab_supervision_metrics/src/metrics.cpp - Metrics CSV
Other components
- Operator
- ABB IRC5 controller
Connections 26
- Operator → RGB camera node: provides video
- Fatigue ROS node → Face landmarks: uses
colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py - Fatigue ROS node → Person detector: uses
colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py - Fatigue ROS node → Person tracker: uses
colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py - Fatigue ROS node → Head pose: uses
colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py - Fatigue ROS node → Attention analysis: uses
colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py - Fatigue ROS node → Blink analysis: uses
colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py - Fatigue ROS node → Expression analysis: uses
colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py - Fatigue ROS node → Fatigue analysis: uses
colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py - Spatial interaction node → Person detector: uses
colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py - Spatial interaction node → Person tracker: uses
colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py - Spatial interaction node → Depth person detector: uses
colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py - Spatial interaction node → Robot detector: uses
colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py - Spatial interaction node → Collision estimator: uses
colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py - Operator condition → Reactive decisions: provides state
- Control supervisor → Reactive decisions: coordinates
- Reactive decisions → Command validator: validates commands
- Reactive decisions → MoveIt commander: coordinates motion
- MoveIt commander → MoveIt configuration: uses planning setup
- Reactive decisions → ABB socket bridge: sends commands
- ABB socket bridge → ABB IRC5 controller: exchanges socket data
- ABB IRC5 controller → ABB socket bridge: returns robot data
- TCP pose parser → ABB socket bridge: parses received pose
- RobotStudio station → ABB IRC5 controller: simulates station
- Experimental metrics → Metrics CSV: writes metrics
colab_supervision_metrics/src/metrics.cpp - Experimental metrics → Reactive decisions: observes commands and trajectories