How maxhawksby/go2-fusion works
Oak is a ROS 2 software stack for a Unitree Go2 robot. The principal workflow is operator- or autonomy-generated motion and sensor data flowing through ROS nodes: the driver connects to the robot, perception and mapping support exploration, and viewers expose results. The README also documents AI/voice, object detection, simulation, and lab measurement capabilities. Some subsystem links are documented only at product level; source-level links below rely on the supplied excerpts and SOURCE INDEX, so unsampled integrations are not asserted.
Main entry points: explorer.py Frontier explorer · agent.py Language agent · go2_driver_node.py Go2 driver · webrtc WebRTC link
Components 26
Robot control
- Keyboard teleop
src/keyboard_teleop/keyboard_teleop/keyboard_teleop.py - Command mux
- Go2 driver
src/go2_robot_sdk/go2_robot_sdk/presentation/go2_driver_node.py - Control service
src/go2_robot_sdk/go2_robot_sdk/application/services/robot_control_service.py - WebRTC link
src/go2_robot_sdk/go2_robot_sdk/infrastructure/webrtc - Robot data service
src/go2_robot_sdk/go2_robot_sdk/application/services/robot_data_service.py
Sensing and perception
- Lidar processing
src/lidar_processor/lidar_processor/point_map.py - Object detector
src/object_detection/object_detection/detector_node.py - COCO detector
src/coco_detector/coco_detector/coco_detector_node.py
Mapping and navigation
- Frontier explorer
src/go2_auto_mapper/go2_auto_mapper/explorer.py - Frontier scoring
src/go2_auto_mapper/go2_auto_mapper/frontier_scoring.py - Obstacle sensing
src/go2_auto_mapper/go2_auto_mapper/obstacle_sensing.py - Recovery logic
src/go2_auto_mapper/go2_auto_mapper/recovery.py - Social space
src/go2_auto_mapper/go2_auto_mapper/social_space.py - Vision ranking
src/go2_auto_mapper/go2_auto_mapper/vlm_ranking.py - Map viewer
src/go2_map_viewer_cpp/src/map_viewer_node.cpp - Mapper panel
src/go2_rviz_plugins/src/auto_mapper_panel.cpp
AI and interaction
- Language agent
src/go2_llm_agent/go2_llm_agent/agent.py - Motion bridge
src/go2_llm_agent/go2_llm_agent/ros2_motion.py - Speech output
src/speech_processor/speech_processor/tts_node.py
Simulation and measurement
- Simulation tools
src/go2_sim/go2_sim/world_tools.py - Exploration trials
src/go2_sim/go2_sim/trials.py - Lab measurement
src/go2_scoreboard/go2_scoreboard/lab_measure.py
Other components
- Operator
- Nav2
- Unitree Go2
Connections 27
- Operator → Keyboard teleop: drives
README.md - Operator → Mapper panel: controls
README.md - Keyboard teleop → Command mux: publishes commands
README.md - Command mux → Go2 driver: selects control
README.md - Go2 driver → Control service: uses services
src/go2_robot_sdk/go2_robot_sdk/presentation/go2_driver_node.py - Control service → WebRTC link: sends commands
- Unitree Go2 → WebRTC link: streams data
README.md - WebRTC link → Robot data service: delivers messages
- Robot data service → Lidar processing: publishes lidar
src/go2_robot_sdk/go2_robot_sdk/application/services/robot_data_service.py - Lidar processing → Frontier explorer: supplies map inputs
- Unitree Go2 → Object detector: provides camera feed
README.md - Object detector → Language agent: provides detections
- Frontier explorer → Frontier scoring: scores frontiers
src/go2_auto_mapper/go2_auto_mapper/explorer.py - Frontier explorer → Obstacle sensing: checks obstacles
src/go2_auto_mapper/go2_auto_mapper/explorer.py - Frontier explorer → Recovery logic: uses recovery
src/go2_auto_mapper/go2_auto_mapper/explorer.py - Frontier explorer → Social space: uses social costs
src/go2_auto_mapper/go2_auto_mapper/explorer.py - Frontier explorer → Vision ranking: ranks views
src/go2_auto_mapper/go2_auto_mapper/explorer.py - Frontier explorer → Nav2: sends navigation goals
src/go2_auto_mapper/go2_auto_mapper/explorer.py - Frontier explorer → Mapper panel: exposes controls
- Operator → Language agent: gives instructions
README.md - Language agent → Motion bridge: dispatches actions
src/go2_llm_agent/go2_llm_agent/agent.py - Motion bridge → Go2 driver: commands motion
- Language agent → Speech output: requests speech
- Operator → Map viewer: views maps
README.md - Simulation tools → Exploration trials: runs trial worlds
src/go2_sim/go2_sim/trials.py - Exploration trials → Frontier explorer: evaluates exploration
- Lab measurement → Operator: reports measurements