How alexaltomi/radarsense works
RadarSense replays recorded 60 GHz radar data to an Android app, which displays live frames and recognizes gestures; no radar hardware is used. The offline workflow processes dataset recordings into range-Doppler/phase frames, creates labeled windows, and trains/evaluates models for mobile inference. The graph preserves the documented training and export capabilities, but those unsampled subsystems are represented at directory level. Some backend and DSP connections are omitted because the excerpts do not establish their call direction.
Main entry points: StreamViewModel.kt Stream orchestration · MainActivity.kt App navigation · FrameStreamClient.kt WebSocket client · server.py Replay WebSocket
Components 29
Android app
- App navigation
android/app/src/main/java/com/radarsense/app/MainActivity.kt - Connect screen
android/app/src/main/java/com/radarsense/app/ui/stream/ConnectScreen.kt - Live display
android/app/src/main/java/com/radarsense/app/ui/stream/LiveScreen.kt - Actions screen
android/app/src/main/java/com/radarsense/app/ui/actions/ActionsScreen.kt - Stream orchestration
android/app/src/main/java/com/radarsense/app/ui/stream/StreamViewModel.kt - WebSocket client
android/app/src/main/java/com/radarsense/app/data/net/FrameStreamClient.kt - Stream protocol
android/app/src/main/java/com/radarsense/app/data/net/StreamProtocol.kt - Frame parser
android/app/src/main/java/com/radarsense/app/data/net/FrameParser.kt - Frame data
android/app/src/main/java/com/radarsense/app/domain/Frame.kt - Frame buffer
android/app/src/main/java/com/radarsense/app/domain/FrameBuffer.kt - Window decoder
android/app/src/main/java/com/radarsense/app/domain/WindowDecoder.kt - Gesture classifier
android/app/src/main/java/com/radarsense/app/data/ml/LiteRtGestureClassifier.kt - Gesture detector
android/app/src/main/java/com/radarsense/app/domain/GestureDetector.kt - Action dispatcher
android/app/src/main/java/com/radarsense/app/domain/ActionDispatcher.kt
Replay service
- Replay WebSocket
backend/replay/replay/server.py - Replay index
backend/replay/replay/index.py - Frame encoding
backend/replay/replay/codec.py - Replay sources
backend/replay/replay/sources.py
Dataset processing
- Processed cache
dsp/radarsense_dsp/cache.py - Radar transforms
dsp/radarsense_dsp/frames.py - Dataset access
dsp/radarsense_dsp/io.py - Window labeling
dsp/radarsense_dsp/windows.py
Model development
- Cache build
training/build_cache.py - Baseline training
training/baseline.py - CNN model
training/model.py - CNN training
training/train.py - Model evaluation
training/eval.py - Model export
training/convert_litert.py
Other components
- App user
Connections 29
- App user → App navigation: opens
android/app/src/main/java/com/radarsense/app/MainActivity.kt - App navigation → Connect screen: shows
android/app/src/main/java/com/radarsense/app/MainActivity.kt - App navigation → Live display: shows
android/app/src/main/java/com/radarsense/app/MainActivity.kt - App navigation → Actions screen: shows
android/app/src/main/java/com/radarsense/app/MainActivity.kt - App navigation → Stream orchestration: creates
android/app/src/main/java/com/radarsense/app/MainActivity.kt - Connect screen → Stream orchestration: configures
- Stream orchestration → WebSocket client: starts stream
android/app/src/main/java/com/radarsense/app/ui/stream/StreamViewModel.kt - WebSocket client → Replay WebSocket: requests frames
README.md - Replay WebSocket → Replay index: builds index
backend/replay/replay/server.py - Replay WebSocket → App user: streams frames
backend/replay/replay/server.py - WebSocket client → Stream protocol: formats messages
android/app/src/main/java/com/radarsense/app/data/net/FrameStreamClient.kt - WebSocket client → Frame parser: parses frames
android/app/src/main/java/com/radarsense/app/data/net/FrameStreamClient.kt - Stream orchestration → Frame buffer: adds frames
android/app/src/main/java/com/radarsense/app/ui/stream/StreamViewModel.kt - Frame buffer → Frame data: stores
android/app/src/main/java/com/radarsense/app/domain/FrameBuffer.kt - Stream orchestration → Window decoder: decodes window
android/app/src/main/java/com/radarsense/app/ui/stream/StreamViewModel.kt - Stream orchestration → Gesture classifier: classifies window
android/app/src/main/java/com/radarsense/app/ui/stream/StreamViewModel.kt - Stream orchestration → Gesture detector: filters predictions
android/app/src/main/java/com/radarsense/app/ui/stream/StreamViewModel.kt - Stream orchestration → Action dispatcher: dispatches fires
android/app/src/main/java/com/radarsense/app/ui/stream/StreamViewModel.kt - Live display → Frame data: renders
android/app/src/main/java/com/radarsense/app/ui/stream/LiveScreen.kt - Actions screen → Action dispatcher: configures
android/app/src/main/java/com/radarsense/app/ui/actions/ActionsScreen.kt - Replay index → Window labeling: loads cache windows
backend/replay/replay/index.py - Cache build → Processed cache: builds
training/build_cache.py - Processed cache → Dataset access: reads recordings
dsp/radarsense_dsp/cache.py - Processed cache → Radar transforms: transforms frames
dsp/radarsense_dsp/cache.py - Baseline training → Window labeling: uses labeled windows
training/baseline.py - CNN training → CNN model: trains
training/train.py - Model evaluation → CNN model: evaluates
training/eval.py - CNN training → Window labeling: loads training windows
training/train.py - Model export → Gesture classifier: exports for inference