How digesaremarco/forest_semantic_navigation works
This repository implements traversability mapping and frontier-based navigation for a Spot robot. The main workflow accepts RGB-D frames and camera pose, runs SegFormer inference, builds a semantic point cloud, fuses observations into a grid, and computes traversability costs; a separate planning interface consumes a cost layer and robot pose to produce waypoints and decide when to replan. Calibration, frame pairing, visualization, and Spot extrinsics querying are additional capabilities. Relationships below follow the pipeline excerpts, SOURCE INDEX references, or explicit module descriptions; unsampled subsystem links are omitted where the caller is not shown.
Main entry points: planning_pipeline.py Planning pipeline · traversability_pipeline.py Traversability pipeline · pointcloud_builder.py Point-cloud builder · grid_map.py Semantic grid map
Components 32
Perception and fusion
- Traversability pipeline
pipeline/traversability_pipeline.py - SegFormer inference
perception/segformer_inference.py - Class reduction
perception/class_reducer.py - Point-cloud builder
fusion/pointcloud_builder.py - Camera calibration
fusion/camera_calibration_loader.py - Frame pairing
fusion/frame_pairing.py - Frame-pose pairing
fusion/frame_pose_pairing.py - Geometry utilities
fusion/geometry_utils.py
Mapping and costs
- Semantic grid map
mapping/grid_map.py - Geometric cost
costmap/geometric_cost.py - Semantic cost
costmap/semantic_cost.py - Cost fusion
costmap/cost_fusion.py - Cost configuration
costmap/costmap_config_loader.py - Grid configuration
mapping/grid_map_config_loader.py - Traversability cost layer
Navigation planning
- Planning pipeline
pipeline/planning_pipeline.py - Frontier detection
planning/frontier_detector.py - Frontier refinement
planning/frontier_refiner.py - Frontier selection
planning/frontier_selector.py - Obstacle inflation
planning/obstacle_inflation.py - A-star planner
planning/path_planner.py - Path smoothing
planning/path_smoother.py - Waypoint generation
planning/waypoint_generator.py - Replanning trigger
planning/replanning_trigger.py - Target blacklist
planning/target_blacklist.py - Planning configuration
planning/planning_config_loader.py
Robot and diagnostics
- Grid visualization
mapping/grid_map_visualizer.py - Planning visualization
planning/planning_visualizer.py - Spot extrinsics query
spot/query_camera_extrinsics.py
Other components
- RGB-D frames
- Cost and robot pose
- Waypoints
Connections 32
- RGB-D frames → Traversability pipeline: updates with
pipeline/traversability_pipeline.py - Traversability pipeline → Point-cloud builder: builds points
pipeline/traversability_pipeline.py - Point-cloud builder → SegFormer inference: runs inference
fusion/pointcloud_builder.py - Point-cloud builder → Class reduction: reduces classes
fusion/pointcloud_builder.py - Point-cloud builder → Camera calibration: reads parameters
fusion/pointcloud_builder.py - Traversability pipeline → Class reduction: constructs
pipeline/traversability_pipeline.py - Traversability pipeline → Semantic grid map: fuses points
pipeline/traversability_pipeline.py - Traversability pipeline → Geometric cost: computes cost
pipeline/traversability_pipeline.py - Traversability pipeline → Semantic cost: computes cost
pipeline/traversability_pipeline.py - Traversability pipeline → Cost fusion: combines costs
pipeline/traversability_pipeline.py - Semantic grid map → Geometric cost: provides elevation
- Semantic grid map → Semantic cost: provides probabilities
- Geometric cost → Traversability pipeline: returns cost
pipeline/traversability_pipeline.py - Semantic cost → Traversability pipeline: returns cost
pipeline/traversability_pipeline.py - Cost fusion → Traversability pipeline: returns fused cost
pipeline/traversability_pipeline.py - Traversability pipeline → Traversability cost layer: provides layer
pipeline/traversability_pipeline.py - Cost and robot pose → Planning pipeline: plans with
pipeline/planning_pipeline.py - Planning pipeline → Frontier detection: detects frontiers
pipeline/planning_pipeline.py - Planning pipeline → Frontier refinement: refines frontiers
pipeline/planning_pipeline.py - Planning pipeline → Frontier selection: selects target
pipeline/planning_pipeline.py - Planning pipeline → Obstacle inflation: inflates obstacles
pipeline/planning_pipeline.py - Planning pipeline → A-star planner: plans path
pipeline/planning_pipeline.py - Planning pipeline → Path smoothing: smooths path
pipeline/planning_pipeline.py - Planning pipeline → Waypoint generation: generates waypoints
pipeline/planning_pipeline.py - Planning pipeline → Replanning trigger: checks replanning
pipeline/planning_pipeline.py - Planning pipeline → Target blacklist: manages targets
pipeline/planning_pipeline.py - Planning pipeline → Waypoints: returns
- Frame pairing → Frame-pose pairing: pairs frames
- Frame-pose pairing → Geometry utilities: uses geometry
fusion/frame_pose_pairing.py - Frame-pose pairing → Camera calibration: reads calibration
fusion/frame_pose_pairing.py - Grid visualization → Semantic grid map: visualizes
mapping/grid_map_visualizer.py - Planning visualization → Grid visualization: uses plots
planning/planning_visualizer.py