How siddeshkhandekar/vedharpan___real-time-3d-spatial-tracking-depth-overlay works
VEDHARPAN combines a webcam-based vision and telemetry backend with a desktop overlay hosting a Three.js 3D diorama. The backend captures and filters tracking data, places frames on a queue, and broadcasts them over WebSockets; the desktop app embeds the frontend. The frontend’s scene coordinates input, physics, effects, settings, and the mecha controller. The README describes vision-to-overlay integration as a roadmap item, and the excerpts do not show a frontend telemetry connection, so that relationship remains unverified.
Main entry points: scene.js Diorama scene · main.py Lifecycle controller · vision_pipeline.py Vision pipeline · input_manager.js Input manager
Components 15
Vision and telemetry
- Vision pipeline
core/vision_pipeline.py - Telemetry queue
main.py - WebSocket broker
main.py - Lifecycle controller
main.py
Desktop presentation
- Transparent overlay
core/gui_overlay.py
3D experience
- Frontend entry page
frontend/index.html - 3D assets
frontend/assets
Scene systems
- Diorama scene
frontend/js/scene.js - Input manager
frontend/js/input_manager.js - Physics world
frontend/js/physics_world.js - Visual effects
frontend/js/effects.js - Mecha controller
frontend/js/mecha_controller.js - Settings manager
frontend/js/settings.js
Other components
- Desktop user
- Webcam
Connections 17
- Desktop user → Webcam: provides video
README.md - Webcam → Vision pipeline: captures frames
README.md - Lifecycle controller → Vision pipeline: starts pipeline
main.py - Vision pipeline → Telemetry queue: enqueues telemetry
core/vision_pipeline.py - Lifecycle controller → WebSocket broker: starts broker
main.py - WebSocket broker → Telemetry queue: reads frames
main.py - Lifecycle controller → Transparent overlay: launches overlay
main.py - Transparent overlay → Frontend entry page: loads page
core/gui_overlay.py - Frontend entry page → Diorama scene: starts scene
frontend/js/scene.js - Diorama scene → 3D assets: loads models
frontend/js/scene.js - Diorama scene → Input manager: creates input
frontend/js/scene.js - Diorama scene → Physics world: creates physics
frontend/js/scene.js - Diorama scene → Visual effects: creates effects
frontend/js/scene.js - Diorama scene → Mecha controller: creates controller
frontend/js/scene.js - Diorama scene → Settings manager: uses settings
frontend/js/scene.js - Desktop user → Input manager: provides controls
frontend/js/input_manager.js - WebSocket broker → Input manager: sends tracking data