# labsir-un/trayectorias_seguras_robotica_colaborativa architecture

> Architecture diagram of the GitHub repository labsir-un/trayectorias_seguras_robotica_colaborativa, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-19). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/labsir-un/trayectorias_seguras_robotica_colaborativa
- Repository: https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa

## Overview

This ROS 2 system supports supervised collaborative-robot operation: camera perception estimates operator condition and robot–operator proximity; control components make reactive decisions and coordinate motion; a socket bridge connects ROS commands and robot state to the ABB controller. Metrics record safety and motion outcomes. The README also documents MoveIt configuration and an ABB RobotStudio station. Several package interactions are described only at package level, so those links are marked unverified; unsampled source is not assumed to establish calls.

Main entry points: [`colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py) (Fatigue ROS node), [`colab_supervision_control/src/control_decision.cpp`](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_control/src/control_decision.cpp) (Reactive decisions), [`colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py`](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py) (Spatial interaction node), [`colab_supervision_abb_brige/src/socket.cpp`](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_abb_brige/src/socket.cpp) (ABB socket bridge)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_perception["Operator perception"]
  node_rgb_camera["RGB camera node<br/>[camera.py]"]
  node_fatigue_node["Fatigue ROS node"]
  node_face_landmarks["Face landmarks"]
  node_person_detector["Person detector<br/>[person_detector.py]"]
  node_person_tracker["Person tracker<br/>[person_tracker.py]"]
  node_head_pose["Head pose"]
  node_attention["Attention analysis"]
  node_blink["Blink analysis<br/>[blink_analyzer.py]"]
  node_expression["Expression analysis"]
  node_fatigue_analysis["Fatigue analysis"]
  node_interaction_node["Spatial interaction node"]
  node_depth_person["Depth person detector"]
  node_robot_detector["Robot detector<br/>[robot_detector.py]"]
  node_collision["Collision estimator"]
end

subgraph group_supervision["Safety supervision"]
  node_operator_condition["Operator condition"]
  node_control_supervisor["Control supervisor"]
  node_command_validator["Command validator"]
  node_decision["Reactive decisions"]
end

subgraph group_motion["Robot motion"]
  node_commander["MoveIt commander"]
  node_moveit_config["MoveIt configuration"]
  node_socket_bridge["ABB socket bridge<br/>[socket.cpp]"]
  node_pose_parser["TCP pose parser"]
  node_robotstudio_station["RobotStudio station<br/>[socket_ver.py]"]
end

subgraph group_observability["Metrics"]
  node_metrics["Experimental metrics<br/>[metrics.cpp]"]
  node_csv[("Metrics CSV")]
end

node_operator(("Operator"))
node_abb_controller["ABB IRC5 controller"]

node_operator -.->|"provides video"| node_rgb_camera
node_fatigue_node -->|"uses"| node_face_landmarks
node_fatigue_node -->|"uses"| node_person_detector
node_fatigue_node -->|"uses"| node_person_tracker
node_fatigue_node -->|"uses"| node_head_pose
node_fatigue_node -->|"uses"| node_attention
node_fatigue_node -->|"uses"| node_blink
node_fatigue_node -->|"uses"| node_expression
node_fatigue_node -->|"uses"| node_fatigue_analysis
node_interaction_node -->|"uses"| node_person_detector
node_interaction_node -->|"uses"| node_person_tracker
node_interaction_node -->|"uses"| node_depth_person
node_interaction_node -->|"uses"| node_robot_detector
node_interaction_node -->|"uses"| node_collision
node_operator_condition -.->|"provides state"| node_decision
node_control_supervisor -.->|"coordinates"| node_decision
node_decision -.->|"validates commands"| node_command_validator
node_decision -.->|"coordinates motion"| node_commander
node_commander -.->|"uses planning setup"| node_moveit_config
node_decision -.->|"sends commands"| node_socket_bridge
node_socket_bridge -.->|"exchanges socket data"| node_abb_controller
node_abb_controller -.->|"returns robot data"| node_socket_bridge
node_pose_parser -.->|"parses received pose"| node_socket_bridge
node_robotstudio_station -.->|"simulates station"| node_abb_controller
node_metrics -->|"writes metrics"| node_csv
node_metrics -.->|"observes commands and trajectories"| node_decision

click node_rgb_camera "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/nodes/camera.py"
click node_fatigue_node "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py"
click node_face_landmarks "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/face_landmark_detector.py"
click node_person_detector "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/person_detector.py"
click node_person_tracker "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/person_tracker.py"
click node_head_pose "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/head_pose_estimator.py"
click node_attention "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/attention_analyzer.py"
click node_blink "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/blink_analyzer.py"
click node_expression "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/expression_analyzer.py"
click node_fatigue_analysis "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/fatigue_analyzer.py"
click node_interaction_node "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py"
click node_depth_person "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/depth_person_detector.py"
click node_robot_detector "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/robot_detector.py"
click node_collision "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/collision_estimator.py"
click node_operator_condition "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_control/src/operator_condition.cpp"
click node_control_supervisor "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_control/src/control_supervisor.cpp"
click node_command_validator "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_control/src/command_validator.cpp"
click node_decision "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_control/src/control_decision.cpp"
click node_commander "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_commander/src/commander_template.cpp"
click node_moveit_config "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_moveit_config/launch/move_group.launch.py"
click node_socket_bridge "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_abb_brige/src/socket.cpp"
click node_pose_parser "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_abb_brige/src/tcp_pose_parser.cpp"
click node_robotstudio_station "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/abb_robotstudio/pack_and_go/socket_ver.py"
click node_metrics "https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_metrics/src/metrics.cpp"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_rgb_camera,node_fatigue_node,node_face_landmarks,node_person_detector,node_person_tracker,node_head_pose,node_attention,node_blink,node_expression,node_fatigue_analysis,node_interaction_node,node_depth_person,node_robot_detector,node_collision toneBlue
class node_operator_condition,node_control_supervisor,node_command_validator,node_decision toneAmber
class node_commander,node_moveit_config,node_socket_bridge,node_pose_parser,node_robotstudio_station toneMint
class node_metrics,node_csv toneRose
class node_operator,node_abb_controller toneIndigo
```

## Components

### Operator perception

- [RGB camera node](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/nodes/camera.py): `colab_supervision_operator/colab_supervision_operator/nodes/camera.py`
- [Fatigue ROS node](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py): `colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`
- [Face landmarks](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/face_landmark_detector.py): `colab_supervision_operator/colab_supervision_operator/perception/face_landmark_detector.py`
- [Person detector](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/person_detector.py): `colab_supervision_operator/colab_supervision_operator/perception/person_detector.py`
- [Person tracker](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/person_tracker.py): `colab_supervision_operator/colab_supervision_operator/perception/person_tracker.py`
- [Head pose](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/head_pose_estimator.py): `colab_supervision_operator/colab_supervision_operator/perception/head_pose_estimator.py`
- [Attention analysis](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/attention_analyzer.py): `colab_supervision_operator/colab_supervision_operator/perception/attention_analyzer.py`
- [Blink analysis](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/blink_analyzer.py): `colab_supervision_operator/colab_supervision_operator/perception/blink_analyzer.py`
- [Expression analysis](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/expression_analyzer.py): `colab_supervision_operator/colab_supervision_operator/perception/expression_analyzer.py`
- [Fatigue analysis](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/fatigue_analyzer.py): `colab_supervision_operator/colab_supervision_operator/perception/fatigue_analyzer.py`
- [Spatial interaction node](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py): `colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py`
- [Depth person detector](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/depth_person_detector.py): `colab_supervision_operator/colab_supervision_operator/perception/depth_person_detector.py`
- [Robot detector](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/robot_detector.py): `colab_supervision_operator/colab_supervision_operator/perception/robot_detector.py`
- [Collision estimator](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_operator/colab_supervision_operator/perception/collision_estimator.py): `colab_supervision_operator/colab_supervision_operator/perception/collision_estimator.py`

### Safety supervision

- [Operator condition](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_control/src/operator_condition.cpp): `colab_supervision_control/src/operator_condition.cpp`
- [Control supervisor](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_control/src/control_supervisor.cpp): `colab_supervision_control/src/control_supervisor.cpp`
- [Command validator](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_control/src/command_validator.cpp): `colab_supervision_control/src/command_validator.cpp`
- [Reactive decisions](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_control/src/control_decision.cpp): `colab_supervision_control/src/control_decision.cpp`

### Robot motion

- [MoveIt commander](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_commander/src/commander_template.cpp): `colab_supervision_commander/src/commander_template.cpp`
- [MoveIt configuration](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_moveit_config/launch/move_group.launch.py): `colab_supervision_moveit_config/launch/move_group.launch.py`
- [ABB socket bridge](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_abb_brige/src/socket.cpp): `colab_supervision_abb_brige/src/socket.cpp`
- [TCP pose parser](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_abb_brige/src/tcp_pose_parser.cpp): `colab_supervision_abb_brige/src/tcp_pose_parser.cpp`
- [RobotStudio station](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/abb_robotstudio/pack_and_go/socket_ver.py): `abb_robotstudio/pack_and_go/socket_ver.py`

### Metrics

- [Experimental metrics](https://github.com/labsir-un/trayectorias_seguras_robotica_colaborativa/blob/main/colab_supervision_metrics/src/metrics.cpp): `colab_supervision_metrics/src/metrics.cpp`
- **Metrics CSV**

### Other components

- **Operator**
- **ABB IRC5 controller**

## Connections

- Operator → RGB camera node: provides video
- Fatigue ROS node → Face landmarks: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`)
- Fatigue ROS node → Person detector: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`)
- Fatigue ROS node → Person tracker: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`)
- Fatigue ROS node → Head pose: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`)
- Fatigue ROS node → Attention analysis: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`)
- Fatigue ROS node → Blink analysis: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`)
- Fatigue ROS node → Expression analysis: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`)
- Fatigue ROS node → Fatigue analysis: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/operator_fatigue.py`)
- Spatial interaction node → Person detector: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py`)
- Spatial interaction node → Person tracker: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py`)
- Spatial interaction node → Depth person detector: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py`)
- Spatial interaction node → Robot detector: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py`)
- Spatial interaction node → Collision estimator: uses (evidence: `colab_supervision_operator/colab_supervision_operator/nodes/robot_operator_interaction.py`)
- Operator condition → Reactive decisions: provides state
- Control supervisor → Reactive decisions: coordinates
- Reactive decisions → Command validator: validates commands
- Reactive decisions → MoveIt commander: coordinates motion
- MoveIt commander → MoveIt configuration: uses planning setup
- Reactive decisions → ABB socket bridge: sends commands
- ABB socket bridge → ABB IRC5 controller: exchanges socket data
- ABB IRC5 controller → ABB socket bridge: returns robot data
- TCP pose parser → ABB socket bridge: parses received pose
- RobotStudio station → ABB IRC5 controller: simulates station
- Experimental metrics → Metrics CSV: writes metrics (evidence: `colab_supervision_metrics/src/metrics.cpp`)
- Experimental metrics → Reactive decisions: observes commands and trajectories
