How pranavshree-ai/nova-ai works
NOVA is a browser-based holographic voice-assistant interface. The user opens the orb UI, starts voice interaction or webcam gestures, and receives spoken responses while gestures and pointer controls manipulate the 3D scene. The main documented branches are voice/transcription and AI actions, hand tracking, and themed 3D rendering. The excerpts establish the page-to-component, component-to-runtime modules, and API-to-agent calls; browser speech synthesis and some UI wiring are not fully shown, so those links are omitted.
Main entry points: JarvisOrb.tsx Orb HUD · useVoiceAgent.ts Voice state and audio · route.ts Assistant API · handTracker.ts Hand tracking
Components 15
Orb interface
- Home page
app/page.tsx - Orb HUD
components/JarvisOrb.tsx - 3D orb scene
lib/orbScene.ts
Gesture controls
- Hand tracking
lib/handTracker.ts
Voice assistant
- Voice state and audio
lib/useVoiceAgent.ts
Assistant services
- Speech transcription
app/api/transcribe/route.ts - Assistant API
app/api/nova/route.ts - Browser actions
lib/browserAgent.ts - Web search
lib/searchAgent.ts
Other components
- User
- Groq AI services
- MediaPipe models
- Web results
- System browser
- Google TTS
Connections 16
- User → Home page: opens
app/page.tsx - Home page → Orb HUD: renders
app/page.tsx - Orb HUD → 3D orb scene: creates and controls
components/JarvisOrb.tsx - Orb HUD → Hand tracking: starts and configures
components/JarvisOrb.tsx - Hand tracking → MediaPipe models: loads vision model
lib/handTracker.ts - Hand tracking → 3D orb scene: gesture callbacks
components/JarvisOrb.tsx - Orb HUD → Voice state and audio: starts and stops
components/JarvisOrb.tsx - Voice state and audio → Speech transcription: uploads audio
- Speech transcription → Groq AI services: transcribes audio
app/api/transcribe/route.ts - Voice state and audio → Assistant API: sends transcript and history
lib/useVoiceAgent.ts - Assistant API → Groq AI services: requests assistant response
app/api/nova/route.ts - Assistant API → Browser actions: executes browser tool
app/api/nova/route.ts - Assistant API → Web search: requests search
app/api/nova/route.ts - Web search → Web results: fetches search results
lib/searchAgent.ts - Browser actions → System browser: opens action URL
lib/browserAgent.ts - Voice state and audio → Google TTS: may request TTS