How sanjeev-r-b/blind_navigation works
Blind Navigation is an assistive vision app that turns camera frames into obstacle detections, distance/risk estimates, and spoken proximity alerts, with a visual camera/dashboard path. The Android app bridges native camera input to Python postprocessing; the repository also contains a desktop Python detection pipeline and a Phase 2 camera-driven pipeline. The README documents detection, overlays, FPS profiling, resolution tuning, and Android camera integration. Some Android and Phase 2 wiring is unsampled, so uncertain links are omitted or marked unverified.
Main entry points: phase2_distance/run_phase2.py Desktop Phase 2 runner · yolo_detector.py YOLO detector · phase2_distance/run_phase2.py Android Phase 2 runner · camera_android.py Android Python bridge
Components 22
Android App
- Native camera host
android/app/src/main/java/com/example/blindnav/CameraActivity.kt - Detection overlay
android/app/src/main/java/com/example/blindnav/OverlayView.kt - Android Python bridge
android/app/src/main/python/camera_android.py - Android Phase 2 runner
android/app/src/main/python/blind_nav/phase2_distance/run_phase2.py
Detection
- Desktop camera feed
blind_nav/phase1_detection/camera/camera_feed.py - Camera bridge
blind_nav/phase1_detection/camera/camera_android.py - YOLO detector
blind_nav/phase1_detection/detection/yolo_detector.py - ONNX inference
blind_nav/phase1_detection/detection/onnx_inference.py - Box renderer
blind_nav/phase1_detection/detection/bbox_renderer.py - FPS counter
blind_nav/phase1_detection/utils/fps_counter.py - Resolution tuner
blind_nav/phase1_detection/utils/resolution_tuner.py
Distance And Risk
- Pinhole estimator
blind_nav/phase2_distance/distance/pinhole_estimator.py - Calibration data
blind_nav/phase2_distance/distance/calibration.json - Depth estimation
blind_nav/phase2_distance/depth/depth_anything.py - Depth fusion
blind_nav/phase2_distance/depth/depth_fusion.py - Frame clipping check
blind_nav/phase2_distance/utils/clip_detector.py - Desktop Phase 2 runner
blind_nav/phase2_distance/run_phase2.py
Feedback
- Alert formatter
blind_nav/phase2_distance/audio/alert_formatter.py - Speech engine
blind_nav/phase2_distance/audio/tts_engine.py - Device audio
- Device display
Other components
- Blind-navigation user
Connections 28
- Blind-navigation user → Native camera host: starts camera
README.md - Native camera host → Android Python bridge: bridges frames
android/app/src/main/python/camera_android.py - Android Python bridge → YOLO detector: delegates detection
android/app/src/main/python/camera_android.py - Android Python bridge → Pinhole estimator: estimates distance
android/app/src/main/python/camera_android.py - Android Python bridge → Alert formatter: formats alerts
android/app/src/main/python/camera_android.py - Android Python bridge → Detection overlay: supplies detections
- Desktop camera feed → YOLO detector: detects objects
blind_nav/phase1_detection/camera/camera_feed.py - Desktop camera feed → Box renderer: renders boxes
blind_nav/phase1_detection/camera/camera_feed.py - Desktop camera feed → FPS counter: measures rate
blind_nav/phase1_detection/camera/camera_feed.py - Resolution tuner → YOLO detector: benchmarks input
blind_nav/phase1_detection/utils/resolution_tuner.py - YOLO detector → ONNX inference: runs inference
blind_nav/phase1_detection/detection/yolo_detector.py - Desktop Phase 2 runner → YOLO detector: detects objects
blind_nav/phase2_distance/run_phase2.py - Desktop Phase 2 runner → Pinhole estimator: estimates distances
blind_nav/phase2_distance/run_phase2.py - Desktop Phase 2 runner → Frame clipping check: checks clipping
blind_nav/phase2_distance/run_phase2.py - Desktop Phase 2 runner → Alert formatter: formats alerts
blind_nav/phase2_distance/run_phase2.py - Desktop Phase 2 runner → Speech engine: queues speech
blind_nav/phase2_distance/run_phase2.py - Desktop Phase 2 runner → Box renderer: renders frame
blind_nav/phase2_distance/run_phase2.py - Desktop Phase 2 runner → FPS counter: measures rate
blind_nav/phase2_distance/run_phase2.py - Pinhole estimator → Calibration data: loads calibration
blind_nav/phase2_distance/distance/pinhole_estimator.py - Depth fusion → Depth estimation: runs depth model
blind_nav/phase2_distance/depth/depth_fusion.py - Android Phase 2 runner → YOLO detector: uses detector
android/app/src/main/python/blind_nav/phase2_distance/run_phase2.py - Android Phase 2 runner → Pinhole estimator: estimates distances
android/app/src/main/python/blind_nav/phase2_distance/run_phase2.py - Android Phase 2 runner → Frame clipping check: checks clipping
android/app/src/main/python/blind_nav/phase2_distance/run_phase2.py - Android Phase 2 runner → Alert formatter: formats alerts
android/app/src/main/python/blind_nav/phase2_distance/run_phase2.py - Android Phase 2 runner → Speech engine: queues speech
android/app/src/main/python/blind_nav/phase2_distance/run_phase2.py - Speech engine → Device audio: speaks alerts
blind_nav/phase2_distance/audio/tts_engine.py - Desktop Phase 2 runner → Device display: shows dashboard
blind_nav/phase2_distance/run_phase2.py - Blind-navigation user → Device display: views feedback
README.md