How anhyeonseo/mobile-bimanual-home-assistant works
ALOHA Mini is a mobile household manipulation platform: a request is planned into a fetch workflow, the robot navigates and observes at safe stops, then manipulates, verifies, and recovers as needed. The repository also contains a ROS task/gateway layer, an arm bridge, and STM32 actuator firmware. The README documents several perception and semantic-mapping capabilities as future work; those are shown as planned branches, not as verified runtime links. Unsampled implementation details are omitted where their connections are not evidenced.
Main entry points: execution.py Task executor · application.py Application service · bimanual_stream_adapter.py Bimanual stream adapter · main.c STM32 board loop
Components 25
Task planning
- Application service
ros2_ws/src/home_robot_tasks/home_robot_tasks/application.py - Fetch planner
ros2_ws/src/home_robot_tasks/home_robot_tasks/fetch.py - Task executor
ros2_ws/src/home_robot_tasks/home_robot_tasks/execution.py - HTTP gateway
ros2_ws/src/home_robot_tasks/home_robot_tasks/gateway.py - Event replay
ros2_ws/src/home_robot_tasks/home_robot_tasks/replay.py
Perception and navigation
- Map navigation
ros2_ws/src/home_robot_tasks/home_robot_tasks/navigation.py - Object search
ros2_ws/src/home_robot_tasks/home_robot_tasks/search.py - RGB-D perception
ros2_ws/src/home_robot_tasks/home_robot_tasks/perception.py - Failure recovery
ros2_ws/src/home_robot_tasks/home_robot_tasks/recovery.py
Manipulation execution
- Manipulation port
ros2_ws/src/home_robot_tasks/home_robot_tasks/manipulation_port.py - Skill ports
ros2_ws/src/home_robot_tasks/home_robot_tasks/skill_ports.py - Arm route builder
ros2_ws/src/home_robot_tasks/home_robot_tasks/arm_routes.py
Robot bridge
- Bimanual stream adapter
ros2_ws/src/so101_arm_bridge/so101_arm_bridge/bimanual_stream_adapter.py - Stream protocol
ros2_ws/src/so101_arm_bridge/so101_arm_bridge/stream_protocol_v2.py - Stream transport
ros2_ws/src/so101_arm_bridge/so101_arm_bridge/stream_transport_v2.py - Joint limits
ros2_ws/src/so101_arm_bridge/so101_arm_bridge/limit_manifest.py
Actuator firmware
- STM32 board loop
firmware/stm32_g474_single_arm/Core/Src/main.c - Mobile output
firmware/stm32_actuator/include/actuator_core/mobile_output.h - Mobile feedback
firmware/stm32_g474_single_arm/Core/Inc/mobile_servo_feedback.h - Servo output
firmware/stm32_g474_single_arm/Core/Inc/mobile_servo_output.h - Servo transport
firmware/stm32_g474_single_arm/Core/Inc/servo_transport.h - Lift controller
firmware/stm32_actuator/src/lift_controller.c - Shared bus router
firmware/stm32_actuator/src/bus_router.c
Other components
- Task requester
- Robot hardware
Connections 22
- Task requester → HTTP gateway: submits request
- HTTP gateway → Application service: routes requests
ros2_ws/src/home_robot_tasks/home_robot_tasks/application.py - Application service → Fetch planner: plans fetch
ros2_ws/src/home_robot_tasks/home_robot_tasks/application.py - Application service → Map navigation: plans navigation
ros2_ws/src/home_robot_tasks/home_robot_tasks/application.py - Application service → Task executor: starts execution
ros2_ws/src/home_robot_tasks/home_robot_tasks/application.py - Task executor → Manipulation port: dispatches skills
ros2_ws/src/home_robot_tasks/home_robot_tasks/execution.py - Task executor → Event replay: records events
ros2_ws/src/home_robot_tasks/home_robot_tasks/execution.py - Task executor → Object search: requests observation
- Object search → RGB-D perception: uses RGB-D
- Task executor → Failure recovery: handles failure
- Manipulation port → Skill ports: uses skill ports
ros2_ws/src/home_robot_tasks/home_robot_tasks/manipulation_port.py - Arm route builder → Bimanual stream adapter: builds arm routes
ros2_ws/src/home_robot_tasks/home_robot_tasks/arm_routes.py - Bimanual stream adapter → Stream protocol: encodes stream
ros2_ws/src/so101_arm_bridge/so101_arm_bridge/bimanual_stream_adapter.py - Bimanual stream adapter → Stream transport: sends stream
ros2_ws/src/so101_arm_bridge/so101_arm_bridge/bimanual_stream_adapter.py - Bimanual stream adapter → Joint limits: loads limits
ros2_ws/src/so101_arm_bridge/so101_arm_bridge/bimanual_stream_adapter.py - STM32 board loop → Mobile feedback: polls feedback
firmware/stm32_g474_single_arm/Core/Src/main.c - STM32 board loop → Servo output: initializes output
firmware/stm32_g474_single_arm/Core/Src/main.c - Mobile feedback → Mobile output: uses output state
firmware/stm32_g474_single_arm/Core/Inc/mobile_servo_feedback.h - Servo output → Servo transport: uses transport
firmware/stm32_g474_single_arm/Core/Inc/mobile_servo_output.h - Lift controller → Robot hardware: controls lift
- Shared bus router → Robot hardware: routes bus traffic
- STM32 board loop → Robot hardware: controls actuators