How opendrivelab/uniad works
UniAD is a planning-oriented autonomous-driving model that hierarchically combines perception, prediction, occupancy reasoning, and planning. Its principal workflow prepares nuScenes examples, trains or evaluates a staged model, and produces task predictions and planning outputs; visualization tools can render results. The README explicitly identifies the end-to-end detector as the task-module coordinator. Other links below are limited to relationships documented in the README or visible in the SOURCE INDEX; unsampled implementation details are not assumed.
Main entry points: uniad_e2e.py Task coordinator · nuscenes_e2e_dataset.py E2E dataset · run.py Visualization runner · panseg_head.py Map segmentation
Components 23
Data preparation
- Dataset converter
tools/data_converter/uniad_nuscenes_converter.py - E2E dataset
projects/mmdet3d_plugin/datasets/nuscenes_e2e_dataset.py - Trajectory labels
projects/mmdet3d_plugin/datasets/data_utils/trajectory_api.py - Vector maps
projects/mmdet3d_plugin/datasets/data_utils/vector_map.py
Perception model
- BEV encoder
projects/mmdet3d_plugin/uniad/detectors/bevformer.py - Tracking
projects/mmdet3d_plugin/uniad/dense_heads/track_head_plugin/modules.py - Map segmentation
projects/mmdet3d_plugin/uniad/dense_heads/panseg_head.py - Segmentation components
projects/mmdet3d_plugin/uniad/dense_heads/seg_head_plugin/seg_detr_head.py
Prediction and planning
- Motion prediction
projects/mmdet3d_plugin/uniad/dense_heads/motion_head.py - Occupancy prediction
projects/mmdet3d_plugin/uniad/dense_heads/occ_head.py - Planning
projects/mmdet3d_plugin/uniad/dense_heads/planning_head.py - Task coordinator
projects/mmdet3d_plugin/uniad/detectors/uniad_e2e.py
Training and evaluation
- Training entry
tools/train.py - Training API
projects/mmdet3d_plugin/uniad/apis/train.py - Model training
projects/mmdet3d_plugin/uniad/apis/mmdet_train.py - nuScenes evaluation
projects/mmdet3d_plugin/datasets/eval_utils/nuscenes_eval.py - Motion evaluation
projects/mmdet3d_plugin/datasets/eval_utils/nuscenes_eval_motion.py
Result inspection
- Visualization runner
tools/analysis_tools/visualize/run.py - BEV renderer
tools/analysis_tools/visualize/render/bev_render.py - Camera renderer
tools/analysis_tools/visualize/render/cam_render.py - Render base
tools/analysis_tools/visualize/render/base_render.py
Other components
- Engineer
- nuScenes data
Connections 21
- Engineer → Dataset converter: prepares data
- nuScenes data → Dataset converter: converts samples
tools/data_converter/uniad_nuscenes_converter.py - Engineer → Training entry: starts training
tools/train.py - Training entry → Training API: invokes
tools/train.py - Training API → Model training: delegates
projects/mmdet3d_plugin/uniad/apis/train.py - Model training → E2E dataset: builds dataset
projects/mmdet3d_plugin/uniad/apis/mmdet_train.py - E2E dataset → Trajectory labels: gets labels
projects/mmdet3d_plugin/datasets/nuscenes_e2e_dataset.py - E2E dataset → Vector maps: uses map data
projects/mmdet3d_plugin/datasets/nuscenes_e2e_dataset.py - E2E dataset → nuScenes evaluation: runs evaluation
projects/mmdet3d_plugin/datasets/nuscenes_e2e_dataset.py - E2E dataset → Motion evaluation: runs motion metrics
projects/mmdet3d_plugin/datasets/nuscenes_e2e_dataset.py - Task coordinator → Tracking: coordinates tasks
- Task coordinator → Map segmentation: coordinates tasks
- Task coordinator → Motion prediction: coordinates tasks
- Task coordinator → Occupancy prediction: coordinates tasks
- Task coordinator → Planning: coordinates tasks
- Map segmentation → Segmentation components: inherits head
projects/mmdet3d_plugin/uniad/dense_heads/panseg_head.py - Engineer → Visualization runner: renders results
tools/analysis_tools/visualize/run.py - Visualization runner → BEV renderer: uses renderer
tools/analysis_tools/visualize/run.py - Visualization runner → Camera renderer: uses renderer
tools/analysis_tools/visualize/run.py - BEV renderer → Render base: inherits
tools/analysis_tools/visualize/render/bev_render.py - Camera renderer → Render base: inherits
tools/analysis_tools/visualize/render/cam_render.py