How autonomousvision/carla_garage works
This repository is a CARLA autonomous-driving starter kit and leaderboard benchmark stack. Users configure routes and an agent, run closed-loop simulation against scenarios, and collect evaluation results; the expert-driving and data-collection code also supports dataset generation. The README documents separate leaderboard variants for ordinary evaluation, privileged data collection, and short Bench2Drive routes. Several implementation relationships below are documented rather than source-verified because the corresponding files were not sampled.
Main entry points: scenarios/scenario_manager.py Route manager · leaderboard_evaluator.py Leaderboard evaluator · scenariomanager/scenario_manager.py Scenario manager · statistics_manager.py Leaderboard statistics
Components 20
Evaluation
- Route configuration
leaderboard/leaderboard/utils/route_parser.py - Leaderboard evaluator
leaderboard/leaderboard/leaderboard_evaluator.py - Route scenarios
leaderboard/leaderboard/scenarios/route_scenario.py - Route manager
leaderboard/leaderboard/scenarios/scenario_manager.py - Agent wrapper
leaderboard/leaderboard/autoagents/agent_wrapper.py - Sensor interface
leaderboard/leaderboard/envs/sensor_interface.py
Simulation
- Scenario runner
scenario_runner/scenario_runner.py - Scenario manager
scenario_runner/srunner/scenariomanager/scenario_manager.py - Scenario behaviors
scenario_runner/srunner/scenariomanager/scenarioatomics/atomic_behaviors.py
Driving Agents
- Agent interface
leaderboard/leaderboard/autoagents/autonomous_agent.py - Privileged expert
team_code/autopilot.py - Bird’s-eye observations
team_code/birds_eye_view/obs_manager.py - Driving controllers
team_code/lateral_controller.py
Data and Analysis
- Data collection
Bench2Drive/tools/data_collect.py - Scenario metrics
scenario_runner/metrics_manager.py - Leaderboard statistics
leaderboard/leaderboard/utils/statistics_manager.py - Checkpoint I/O
leaderboard/leaderboard/utils/checkpoint_tools.py - Result output
leaderboard/leaderboard/utils/result_writer.py
Other components
- Benchmark user
- CARLA simulator
Connections 20
- Benchmark user → Leaderboard evaluator: runs evaluation
README.md - Benchmark user → Route configuration: selects routes
README.md - Leaderboard evaluator → Route scenarios: evaluates routes
- Leaderboard evaluator → Route manager: manages route run
- Route manager → Agent wrapper: invokes agent
leaderboard/leaderboard/scenarios/scenario_manager.py - Route manager → Sensor interface: reads sensor data
leaderboard/leaderboard/scenarios/scenario_manager.py - Scenario runner → Scenario manager: runs scenarios
- Scenario manager → Scenario behaviors: ticks behavior tree
- Scenario manager → CARLA simulator: advances simulation
- Sensor interface → CARLA simulator: receives measurements
- Agent wrapper → Agent interface: delegates control
leaderboard/leaderboard/autoagents/agent_wrapper.py - Agent interface → Sensor interface: consumes observations
- Privileged expert → Bird’s-eye observations: uses observations
- Privileged expert → Driving controllers: computes controls
- Benchmark user → Data collection: collects dataset
README.md - Data collection → Privileged expert: uses expert driver
README.md - Scenario runner → Scenario metrics: reports metrics
- Route manager → Leaderboard statistics: records outcomes
- Leaderboard statistics → Checkpoint I/O: loads checkpoint
leaderboard/leaderboard/utils/statistics_manager.py - Leaderboard statistics → Result output: writes results