How flowshift-in/iris-x works
IRIS-MX is presented as a voice-first mobile assistant: spoken commands stream bidirectionally to Gemini Live, which recognizes intent and asks the mobile execution engine to perform device actions. The repository also contains a React Native dashboard, native audio/ML engines, and backend voice services. README statements support the principal workflow and device capabilities; source excerpts support the dashboard composition and native C++ processing. Backend and several native integrations are represented at directory level because their implementation was not sampled.
Main entry points: index.tsx Assistant dashboard · main.go Voice gateway · IrisNativeEngine.kt Mobile execution engine · IrisNativeVisualizer.tsx Native visualizer
Components 20
Mobile experience
- Assistant dashboard
app/(tabs)/index.tsx - Voice orb
components/IrisHolographicOrb.tsx - Voice interface
components/VoiceNode.tsx - Biometric panel
components/IrisBiometricScanner.tsx - Native visualizer
components/IrisNativeVisualizer.tsx - Matrix view
android/app/src/main/java/com/x201harsh/IRISMX/ui/views/IrisNativeHolographicMatrixView.kt
Audio and inference
- Audio capture
android/app/src/main/java/com/x201harsh/IRISMX/audio/IrisAudioRecorderEngine.kt - Native audio engine
android/app/src/main/cpp/iris_core_engine.cpp - Rust speech core
core_engine/src/lib.rs - Beam decoder
core_engine/src/beam_search.rs
Voice services
- Voice gateway
services/voice_gateway/main.go - Session manager
services/session_manager/session.go - Speech recognition
services/speech_to_text/stt_service.go - Speech synthesis
services/text_to_speech/tts_service.go - Authentication
services/auth_server/auth.go
Device capabilities
- Mobile execution engine
android/app/src/main/java/com/x201harsh/IRISMX/core/IrisNativeEngine.kt - Phone actions
android/app/src/main/java/com/x201harsh/IRISMX - Voice security
android/app/src/main/java/com/x201harsh/IRISMX/security
Other components
- User
- Gemini Live
Connections 17
- User → Gemini Live: speaks to
README.md - Gemini Live → Mobile execution engine: routes intent
README.md - Mobile execution engine → Phone actions: executes on
README.md - User → Assistant dashboard: uses
- Assistant dashboard → Voice orb: renders
app/(tabs)/index.tsx - Assistant dashboard → Voice interface: renders
app/(tabs)/index.tsx - Assistant dashboard → Biometric panel: renders
app/(tabs)/index.tsx - Assistant dashboard → Native visualizer: renders
app/(tabs)/index.tsx - Native visualizer → Matrix view: may use
- Audio capture → Gemini Live: streams audio
README.md - Native audio engine → Mobile execution engine: supports processing
- Voice gateway → Session manager: manages sessions
- Voice gateway → Speech recognition: transcribes
- Voice gateway → Speech synthesis: synthesizes
- Voice gateway → Authentication: authenticates
- Rust speech core → Beam decoder: exports module
core_engine/src/lib.rs - Mobile execution engine → Voice security: uses voice security