How zwandering/sysnav works
SysNav is a multi-level object-navigation system for a wheeled robot and Unity simulation on this branch. Its documented workflow is semantic guidance from vision-language models, room-based navigation, classical in-room exploration, and motion control. The tree also shows SLAM, perception, route-graph, autonomy, and simulation components. README statements support the high-level workflow; source excerpts do not expose wiring among most of these runtime components, so those connections are omitted rather than inferred.
Main entry points: tare_planner Room Exploration · localPlanner.cpp Local Planner · single_object_new.py Semantic Mapping · vlm_reasoning_node.py VLM Reasoning
Components 20
Perception and Mapping
- SLAM
src/slam/arise_slam_mid360/include/arise_slam_mid360/LidarProcess/PointCloudStorage.h - Semantic Mapping
src/semantic_mapping/semantic_mapping/single_object_new.py - Video Segmentation
src/semantic_mapping/semantic_mapping/external/sam2/sam2/sam2_video_predictor.py
Semantic Guidance
- VLM Reasoning
src/vlm_node/vlm_node/vlm_reasoning_node.py - Keyboard Input
src/vlm_node/vlm_node/keyboard_input.py
Navigation Planning
- Boundary Graph
src/route_planner/boundary_handler/src/graph_extractor.cpp - Graph Decoder
src/route_planner/graph_decoder/src/decoder_node.cpp - Room Exploration
src/exploration_planner/tare_planner - Viewpoint Manager
src/exploration_planner/tare_planner/src/viewpoint_manager/viewpoint_manager.cpp
Motion and Autonomy
- Terrain Analysis
src/base_autonomy/terrain_analysis/src/terrainAnalysis.cpp - Extended Terrain
src/base_autonomy/terrain_analysis_ext/src/terrainAnalysisExt.cpp - Local Planner
src/base_autonomy/local_planner/src/localPlanner.cpp - Path Follower
src/base_autonomy/local_planner/src/pathFollower.cpp - Waypoint Example
src/base_autonomy/waypoint_example/src/waypointExample.cpp
Robot and Simulation
- Vehicle Simulator
src/base_autonomy/vehicle_simulator/src/vehicleSimulator.cpp - Visualization Tools
src/base_autonomy/visualization_tools/src/visualizationTools.cpp
Other components
- Navigation Request
- Lidar and Camera
- Wheeled Robot
- Unity Simulation
Connections 11
- Navigation Request → VLM Reasoning: requests target
- Lidar and Camera → SLAM: provides scans
- Lidar and Camera → Semantic Mapping: provides imagery
- Semantic Mapping → Video Segmentation: uses segmentation
- VLM Reasoning → Room Exploration: guides navigation
- Room Exploration → Local Planner: plans motion
- Local Planner → Path Follower: controls path
- Local Planner → Wheeled Robot: drives robot
- Vehicle Simulator → Unity Simulation: simulates vehicle
- Room Exploration → Viewpoint Manager: manages viewpoints
src/exploration_planner/tare_planner/src/viewpoint_manager/viewpoint_manager.cpp - Boundary Graph → Graph Decoder: extracts graph