How mridulsrivastavaaa/fsoc_tracker works
NETRA is an FSOC virtual-camera tracking and coarse-alignment system, with a Python tracking engine and a React/Three.js mission-control application. The operator workflow configures a scenario, runs a closed-loop simulation or video analysis, and inspects tracking telemetry and results. The Python engine coordinates scene input, disturbances, perception, tracking, and camera control; the web engine provides a parallel local simulation and the HUD presents its state. The README documents desktop and server operation as well. Some subsystem connections are documented rather than verified in sampled implementation excerpts.
Main entry points: engine.py Closed-loop engine · engine.ts Web simulation · main.py CLI · App.tsx Mission-control UI
Components 31
Python entry points
- CLI
fsoc_engine/src/fsoc/cli/main.py
Python tracking runtime
- Python config
fsoc_engine/src/fsoc/core/config.py - Scene source
fsoc_engine/src/fsoc/simulation/sim_source.py - Disturbances
fsoc_engine/src/fsoc/disturbances/engine.py - Image preprocessing
fsoc_engine/src/fsoc/vision/preprocess.py - Beacon detector
fsoc_engine/src/fsoc/vision/detector.py - CNN verifier
fsoc_engine/src/fsoc/vision/cnn_verifier.py - Optical flow
fsoc_engine/src/fsoc/vision/optical_flow.py - Wide search
fsoc_engine/src/fsoc/vision/wide_search.py - Kalman tracker
fsoc_engine/src/fsoc/tracking/kalman.py - IMM tracker
fsoc_engine/src/fsoc/tracking/imm.py - Particle recovery
fsoc_engine/src/fsoc/tracking/particle_filter.py - Track state
fsoc_engine/src/fsoc/tracking/state_machine.py - PID control
fsoc_engine/src/fsoc/control/pid_controller.py - Adaptive control
fsoc_engine/src/fsoc/advanced/adaptive_controller.py - Closed-loop engine
fsoc_engine/src/fsoc/core/engine.py - Video input
fsoc_engine/src/fsoc/video/video_source.py
Web simulation
- Web config
web/src/core/config.ts - Web simulation
web/src/core/engine.ts - Web detection
web/src/core/detection/registry.ts - Web gimbal control
web/src/core/control/gimbal.ts - Simulation worker
web/src/engine/worker.ts - Batch worker
web/src/engine/batch.worker.ts
Web mission control
- Application state
web/src/state/store.ts - Mission-control UI
web/src/app/App.tsx - Analysis report
web/src/core/analysis/report.ts - 3D scene
web/src/scene/Stage.tsx - Video analysis
web/src/core/video/analyzer.ts
Operator interfaces
- Telemetry server
fsoc_engine/src/fsoc/server/app.py - Desktop GUI
fsoc_engine/src/fsoc/gui/app.py
Other components
- Operator
Connections 32
- Operator → CLI: runs commands
- CLI → Closed-loop engine: runs simulation
fsoc_engine/src/fsoc/cli/main.py - CLI → Telemetry server: launches service
- CLI → Desktop GUI: launches GUI
fsoc_engine/src/fsoc/cli/main.py - Closed-loop engine → Python config: uses settings
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Scene source: gets frames
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Disturbances: applies effects
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Image preprocessing: processes frames
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Beacon detector: finds candidates
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → CNN verifier: verifies candidates
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Optical flow: estimates flow
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Wide search: searches field
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → IMM tracker: tracks target
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Kalman tracker: tracks target
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Particle recovery: recovers lock
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Track state: updates state
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → PID control: commands camera
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Adaptive control: adapts control
fsoc_engine/src/fsoc/core/engine.py - Closed-loop engine → Video input: accepts video
- Telemetry server → Closed-loop engine: runs tracking
fsoc_engine/src/fsoc/server/app.py - Telemetry server → Video input: analyzes video
fsoc_engine/src/fsoc/server/app.py - Operator → Mission-control UI: uses mission control
- Mission-control UI → Application state: reads state
web/src/app/App.tsx - Mission-control UI → 3D scene: renders scene
web/src/app/App.tsx - Application state → Simulation worker: dispatches commands
web/src/state/store.ts - Application state → Analysis report: builds analysis
web/src/state/store.ts - Simulation worker → Web simulation: runs simulation
web/src/engine/worker.ts - Batch worker → Web simulation: runs batches
web/src/engine/batch.worker.ts - Web simulation → Web config: uses settings
web/src/core/engine.ts - Web simulation → Web detection: creates detector
web/src/core/engine.ts - Web simulation → Web gimbal control: controls gimbal
web/src/core/engine.ts - Mission-control UI → Video analysis: offers video bench