How dhiaelhak-rached/dracoviloc works
DracoViLoc combines camera-based YOLO detection with ODAS-separated audio and selectable audio classifiers, then optionally fuses directions through an EKF and tracks them with a robot arm. The documented workflow starts YOLO separately in an Isaac ROS container, then launches host-side audio, fusion, and mock-arm components. The graph preserves AST, GRE, and direct-tracking alternatives. Relationships are based on the README’s workflow and capability descriptions; unsampled implementations are represented by their exact paths, without asserting internal calls not shown.
Main entry points: lib_odas_server_node.py ODAS audio pipeline · ekf_node.cpp Direction EKF · arm_audio_demo.launch.py Demo orchestration · direction_publisher.py YOLO direction
Components 19
Visual perception
- YOLO launch
isaac_ros/packages/isaac_ros_yolo_direction/launch/yolo_camera.launch.py - YOLO direction
isaac_ros/packages/isaac_ros_yolo_direction/isaac_ros_yolo_direction/direction_publisher.py
Audio perception
- ODAS audio pipeline
src/odas_ros/odas_ros/lib_odas_server_node.py - ODAS core
src/odas_ros/src/odas_core_node.cpp - AST classifier
src/dracoviloc_ast/ast/ast_classifier_node.py - GRE classifier
src/dracoviloc_gre/gre/gre_classifier_node.py - MobileNet classifier
src/dracoviloc_mobilenetv2/mobilenetv2/classifier_node.py - TensorRT runner
src/dracoviloc_mobilenetv2/mobilenetv2/trt_engine.py
Fusion and tracking
- Direction EKF
src/dracoviloc_ekf/src/ekf_node.cpp - Audio tracker
src/dracoviloc_tracking/src/arm_audio_tracker.cpp - Drone tracker
src/dracoviloc_tracking/src/arm_drone_tracker.cpp - Demo orchestration
src/dracoviloc_bringup/launch/arm_audio_demo.launch.py
Robot control
- Mock robot
src/fairino_hardware/src/fairino_hardware_interface.cpp - Robot command server
src/fairino_hardware/src/command_server.cpp
Robot SDK
- Fairino C++ SDK
fairino-cpp-sdk/libfairino/src/src/Robot/robot.cpp
Other components
- Operator
- Camera
- UMA16 microphone
- Fairino robot
Connections 24
- Operator → YOLO launch: starts camera launch
- Camera → YOLO direction: provides images
- YOLO launch → YOLO direction: launches
- YOLO direction → Direction EKF: supplies direction
- Operator → Demo orchestration: starts host workflow
- UMA16 microphone → ODAS audio pipeline: provides audio
- ODAS audio pipeline → ODAS core: runs processing
- ODAS audio pipeline → AST classifier: provides separated audio
- ODAS audio pipeline → GRE classifier: provides separated audio
- ODAS audio pipeline → MobileNet classifier: provides separated audio
- MobileNet classifier → TensorRT runner: runs inference
- AST classifier → Direction EKF: optional direction source
- GRE classifier → Direction EKF: optional direction source
- MobileNet classifier → Direction EKF: optional direction source
- Demo orchestration → ODAS audio pipeline: launches audio
- Demo orchestration → MobileNet classifier: selects classifier
- Demo orchestration → Direction EKF: configures fusion
- Direction EKF → Audio tracker: provides direction
- YOLO direction → Drone tracker: supports direct tracking
- Audio tracker → Mock robot: commands motion
- Drone tracker → Mock robot: commands motion
- Demo orchestration → Mock robot: selects mock mode
- Robot command server → Fairino C++ SDK: uses robot API
- Fairino C++ SDK → Fairino robot: controls robot