How sigz26/nhlstenden-air-hockey-ai works
Orion Vision is a desktop air-hockey vision and reinforcement-learning application. The user enters through the Qt interface, chooses a dashboard, and can process live camera input into puck telemetry; the live path can bridge observations to a simulation and SAC agent. A separate trainer workflow builds and trains agents against opponent policies. The README confirms simulation and reinforcement learning, while the source index shows UI wiring and worker dependencies. Several modules are unsampled, so their internal links are omitted where the available evidence does not establish them.
Main entry points: main_window.py Main window · live_dashboard.py Live dashboard · live_worker.py Camera worker · gige_worker.py GigE worker
Components 25
Desktop interface
- Application entry
Orion Vision/main.py - Main window
Orion Vision/ui/main_window.py - Main menu
Orion Vision/ui/main_menu.py - Intro screen
Orion Vision/intro/intro_widget.py - Video dashboard
Orion Vision/ui/dashboard.py - Live dashboard
Orion Vision/ui/live_dashboard.py - Settings dashboard
Orion Vision/ui/settings_dashboard.py - Trainer dashboard
Orion Vision/ui/ai_trainer_dashboard.py - Digital twin view
Orion Vision/ui/widgets/digital_twin_widget.py
Vision pipeline
- Camera worker
Orion Vision/core/live_worker.py - GigE worker
Orion Vision/core/gige_worker.py - Detection engines
Orion Vision/core/engines - ArUco tracking
Orion Vision/core/engines/aruco_tracker.py - Auto calibration
Orion Vision/core/auto_calibration.py - Table overlay
Orion Vision/core/table_overlay.py
Simulation and AI
- Telemetry bridge
Orion Vision/core/sim_bridge.py - Air-hockey environment
Orion Vision/ai/air_hockey_env.py - SAC controller
Orion Vision/ai/sac_controller.py - Agent worker
Orion Vision/ai/agent_worker.py
Agent training
- Trainer worker
Orion Vision/ai/trainer_worker.py - Opponent policies
Orion Vision/ai/opponents - Trained policies
Orion Vision/models
Other components
- Operator
- Camera
- Video source
Connections 34
- Operator → Application entry: starts
Orion Vision/main.py - Application entry → Main window: opens
Orion Vision/main.py - Main window → Intro screen: shows
Orion Vision/ui/main_window.py - Main window → Main menu: routes to
Orion Vision/ui/main_window.py - Main window → Video dashboard: routes to
Orion Vision/ui/main_window.py - Main window → Live dashboard: routes to
Orion Vision/ui/main_window.py - Main window → Settings dashboard: routes to
Orion Vision/ui/main_window.py - Main window → Trainer dashboard: routes to
Orion Vision/ui/main_window.py - Video dashboard → Video source: reads
Orion Vision/ui/dashboard.py - Video dashboard → Camera worker: uses
- Live dashboard → Camera worker: starts
Orion Vision/ui/live_dashboard.py - Live dashboard → GigE worker: starts
Orion Vision/ui/live_dashboard.py - Camera → Camera worker: supplies frames
- Camera → GigE worker: supplies frames
- Camera worker → Detection engines: dispatches frames
Orion Vision/core/live_worker.py - GigE worker → Detection engines: dispatches frames
Orion Vision/core/gige_worker.py - Camera worker → Telemetry bridge: publishes telemetry
Orion Vision/core/live_worker.py - GigE worker → Telemetry bridge: publishes telemetry
Orion Vision/core/gige_worker.py - Camera worker → ArUco tracking: uses tracking
Orion Vision/core/live_worker.py - GigE worker → ArUco tracking: uses tracking
Orion Vision/core/gige_worker.py - Camera worker → Table overlay: uses overlay
Orion Vision/core/live_worker.py - GigE worker → Table overlay: uses overlay
Orion Vision/core/gige_worker.py - Live dashboard → Auto calibration: configures
Orion Vision/ui/live_dashboard.py - Live dashboard → Telemetry bridge: configures
Orion Vision/ui/live_dashboard.py - Live dashboard → Agent worker: starts
Orion Vision/ui/live_dashboard.py - Live dashboard → Digital twin view: opens
Orion Vision/ui/live_dashboard.py - Digital twin view → Telemetry bridge: reads state
Orion Vision/ui/widgets/digital_twin_widget.py - Agent worker → SAC controller: uses
Orion Vision/ai/agent_worker.py - SAC controller → Telemetry bridge: reads observations
Orion Vision/ai/sac_controller.py - Trainer dashboard → Trainer worker: starts
Orion Vision/ui/ai_trainer_dashboard.py - Trainer worker → Air-hockey environment: trains in
Orion Vision/ai/trainer_worker.py - Trainer worker → SAC controller: uses
Orion Vision/ai/trainer_worker.py - Air-hockey environment → Opponent policies: uses opponents
Orion Vision/ai/air_hockey_env.py - Trainer worker → Trained policies: saves policies