How vijayscodehub/ml_pedestrian_detection_and_tracking works
This is a KITTI camera–LiDAR pedestrian perception research pipeline. Its principal workflow loads a frame and calibration, detects and tracks pedestrians in RGB, projects LiDAR points into camera coordinates, associates robust depth and 3D position with each box, then renders results and writes tracking/fusion artifacts for evaluation. A separate early-fusion branch rasterizes LiDAR depth images and prepares YOLO datasets; the README also documents detector training and comparison of RGB and depth inputs. Edges reflect the shown runners and explicit README capabilities; unsampled training internals are not inferred.
Main entry points: run_tracking_sequence.py Sequence Runner · run_pipeline.py Object Pipeline Runner · kitti.py KITTI Frame Loading · generate_depth_images.py Depth Image Generation
Components 20
KITTI Data & Geometry
- KITTI Frame Loading
src/pedestrian_pipeline/kitti.py - Camera Calibration
src/pedestrian_pipeline/calibration.py
Detection & Fusion
- Object Pipeline Runner
scripts/run_pipeline.py - Sequence Runner
scripts/run_tracking_sequence.py - YOLO ByteTrack
src/pedestrian_pipeline/detector.py - LiDAR Box Association
src/pedestrian_pipeline/fusion.py
Outputs & Evaluation
- Frame Annotation
src/pedestrian_pipeline/visualization.py - Annotated Frames
outputs - Tracking Predictions
src/pedestrian_pipeline/evaluation.py - Fused Detection Records
scripts/run_tracking_sequence.py - Tracking Metrics
src/pedestrian_pipeline/evaluation.py - LiDAR Distance Metrics
src/pedestrian_pipeline/evaluation.py
Depth & Dataset Preparation
- Depth Image Generation
scripts/generate_depth_images.py - Depth Rasterization
src/pedestrian_pipeline/depth.py - YOLO Dataset Preparation
src/pedestrian_pipeline/training.py - YOLO Detector Training
src/pedestrian_pipeline/training.py - Camera-Aligned Depth Images
outputs - YOLO Dataset
outputs
Other components
- Researcher
- Ultralytics YOLO
Connections 33
- Researcher → Object Pipeline Runner: runs frames
scripts/run_pipeline.py - Object Pipeline Runner → KITTI Frame Loading: loads frames
scripts/run_pipeline.py - KITTI Frame Loading → Camera Calibration: loads calibration
src/pedestrian_pipeline/kitti.py - Object Pipeline Runner → YOLO ByteTrack: tracks image
scripts/run_pipeline.py - Object Pipeline Runner → Camera Calibration: projects LiDAR
scripts/run_pipeline.py - Object Pipeline Runner → LiDAR Box Association: associates points
scripts/run_pipeline.py - Object Pipeline Runner → Frame Annotation: renders detections
scripts/run_pipeline.py - Object Pipeline Runner → Annotated Frames: writes frames
scripts/run_pipeline.py - Researcher → Sequence Runner: runs sequence
scripts/run_tracking_sequence.py - Sequence Runner → KITTI Frame Loading: loads sequence
scripts/run_tracking_sequence.py - Sequence Runner → YOLO ByteTrack: tracks image
scripts/run_tracking_sequence.py - Sequence Runner → Camera Calibration: projects LiDAR
scripts/run_tracking_sequence.py - Sequence Runner → LiDAR Box Association: associates points
scripts/run_tracking_sequence.py - Sequence Runner → Frame Annotation: renders detections
scripts/run_tracking_sequence.py - Sequence Runner → Annotated Frames: writes frames
scripts/run_tracking_sequence.py - Sequence Runner → Tracking Predictions: writes predictions
scripts/run_tracking_sequence.py - Sequence Runner → Fused Detection Records: writes associations
scripts/run_tracking_sequence.py - Researcher → Tracking Metrics: evaluates tracks
- Researcher → LiDAR Distance Metrics: evaluates distance
- Tracking Predictions → Tracking Metrics: scores tracks
scripts/evaluate_tracking.py - Fused Detection Records → LiDAR Distance Metrics: scores positions
scripts/run_tracking_sequence.py - Researcher → Depth Image Generation: generates depth
scripts/generate_depth_images.py - Depth Image Generation → KITTI Frame Loading: loads point clouds
scripts/generate_depth_images.py - Depth Image Generation → Depth Rasterization: rasterizes points
scripts/generate_depth_images.py - Depth Image Generation → Camera-Aligned Depth Images: writes images
scripts/generate_depth_images.py - Researcher → YOLO Dataset Preparation: prepares dataset
- YOLO Dataset Preparation → KITTI Frame Loading: reads sequences
src/pedestrian_pipeline/training.py - YOLO Dataset Preparation → Depth Rasterization: builds depth inputs
src/pedestrian_pipeline/training.py - YOLO Dataset Preparation → YOLO Dataset: writes splits
src/pedestrian_pipeline/training.py - Researcher → YOLO Detector Training: trains detector
README.md - YOLO Detector Training → Ultralytics YOLO: uses YOLO
README.md - Camera-Aligned Depth Images → YOLO Detector Training: depth input
README.md - YOLO Dataset → YOLO Detector Training: training data
README.md