How zanebeeai/wallhacks works
Wallhacks is a multi-sensor mmWave system whose main user workflow runs from radar detections through host-side fusion and tracking to live WebXR target pings and a confidence heatmap. The documented multi-headset mode adds master/slave registration and pose alignment. The graph emphasizes that deployment path while retaining the hardware host tooling and radar test utility. Some firmware and frontend details are documented but not sampled; their links are based on README statements, not source inspection.
Main entry points: main.py Host runtime · fusion.py Coordinate fusion · server.py Multi-headset server · index.html WebXR client
Components 21
Radar hardware
- Five-radar array
- ESP32 node A
hardware/wyfyre_array_mvp/firmware/esp32_array_node_a/esp32_array_node_a.ino - ESP32 node B
hardware/wyfyre_array_mvp/firmware/esp32_array_node_b/esp32_array_node_b.ino
Host processing
- Host runtime
hardware/wyfyre_array_mvp/python/main.py - Serial receiver
hardware/wyfyre_array_mvp/python/transport_serial.py - UDP receiver
hardware/wyfyre_array_mvp/python/transport_udp.py - Dataset logger
hardware/wyfyre_array_mvp/python/dataset_logger.py - Webcam capture
hardware/wyfyre_array_mvp/python/webcam_stub.py
Fusion pipeline
- Geometry and calibration
hardware/wyfyre_array_mvp/python/config_loader.py - Detection and track models
hardware/wyfyre_array_mvp/python/models.py - Coordinate fusion
hardware/wyfyre_array_mvp/python/fusion.py - Clustering and tracking
hardware/wyfyre_array_mvp/python/fusion.py - Confidence heatmap
hardware/wyfyre_array_mvp/python/fusion.py - CV feedback adapter
hardware/wyfyre_array_mvp/python/cv_feedback.py
AR collaboration
- Multi-headset server
AR_tailscale_multi/server.py - AR fusion engine
AR_tailscale_multi/fusion.py - WebXR client
AR_tailscale_multi/index.html
Calibration and diagnostics
- Calibration tool
hardware/wyfyre_array_mvp/python/calibrate.py - LD2450 test interface
hardware/ld2450_test/mapping.py - LD2450 serial protocol
hardware/ld2450_test/serial_protocol.py
Other components
- Headset user
Connections 23
- Five-radar array → ESP32 node A: provide detections
README.md - Five-radar array → ESP32 node B: provide detections
README.md - ESP32 node B → ESP32 node A: relay via ESP-NOW
README.md - ESP32 node A → Serial receiver: send JSON lines
README.md - Host runtime → Serial receiver: starts receiver
hardware/wyfyre_array_mvp/python/main.py - Host runtime → UDP receiver: selects transport
hardware/wyfyre_array_mvp/python/main.py - Host runtime → Geometry and calibration: loads settings
hardware/wyfyre_array_mvp/python/main.py - Host runtime → Coordinate fusion: processes detections
hardware/wyfyre_array_mvp/python/main.py - Host runtime → Dataset logger: logs sessions
hardware/wyfyre_array_mvp/python/main.py - Host runtime → Webcam capture: captures video
hardware/wyfyre_array_mvp/python/main.py - Coordinate fusion → Geometry and calibration: reads geometry
hardware/wyfyre_array_mvp/python/fusion.py - Coordinate fusion → Detection and track models: creates results
- Coordinate fusion → Clustering and tracking: associates tracks
hardware/wyfyre_array_mvp/python/fusion.py - Coordinate fusion → Confidence heatmap: builds occupancy
hardware/wyfyre_array_mvp/python/fusion.py - Coordinate fusion → CV feedback adapter: adjusts confidence
hardware/wyfyre_array_mvp/python/fusion.py - Host runtime → Multi-headset server: serves live application
- Multi-headset server → AR fusion engine: processes radar stream
AR_tailscale_multi/server.py - Multi-headset server → WebXR client: streams WebSocket frames
README.md - Headset user → WebXR client: views AR and radar
README.md - WebXR client → Multi-headset server: registers role and pose
AR_tailscale_multi/server.py - Multi-headset server → WebXR client: relays master pose
README.md - Calibration tool → Geometry and calibration: uses configuration
- LD2450 test interface → LD2450 serial protocol: uses serial protocol
hardware/ld2450_test/mapping.py