How sudhakar-2005/jarvis-demo- works
J.A.R.V.I.S. is a browser-based assistant HUD combining voice-command handling, system and workspace controls, planning, memory, and visualization. The principal visible workflow starts in the HUD, where App manages voice input and command routing, then presents feature panels and results. A separate spatial-input path uses the camera and hand tracking to turn gestures into UI actions. The excerpts show selected component wiring and spatial internals; other feature modules are retained as capability nodes, but uncertain connections are omitted.
Main entry points: App.tsx HUD and routing · SpatialInteractionController.ts Spatial interaction controller · ArchitectureFlowDiagram.tsx Architecture viewer · SettingsModal.tsx Assistant settings
Components 30
Assistant HUD
- HUD and routing
src/App.tsx - Command console
src/components/CommandConsole.tsx - Assistant avatar
src/components/ArcReactorAvatar.tsx
Assistant Capabilities
- Architecture viewer
src/components/ArchitectureFlowDiagram.tsx - Graph canvas
src/components/ArchitectureGraphCanvas.tsx - System controls
src/components/SystemControlPanel.tsx - Workspace files
src/components/FileActionsManager.tsx - Skill plugins
src/components/SkillPluginManager.tsx - Task planning
src/components/PlanningLLMPanel.tsx - Screen vision
src/components/ScreenVisionPanel.tsx - Memory dashboard
src/components/MemoryDashboard.tsx - Undo history
src/components/UndoHistoryPanel.tsx - Thermal history
src/components/ThermalHistoryChart.tsx - Voice discovery
src/components/VoiceCommandDiscovery.tsx - Assistant settings
src/components/SettingsModal.tsx
Spatial Interaction
- Spatial interaction controller
src/spatial/SpatialInteractionController.ts - Camera lifecycle
src/spatial/CameraManager.ts - Hand tracking
src/spatial/HandTracker.ts - Landmark processing
src/spatial/LandmarkProcessor.ts - Gesture recognition
src/spatial/GestureRecognizer.ts - Gesture interpretation
src/spatial/GestureInterpreter.ts - Interaction state
src/spatial/InteractionStateManager.ts - Spatial cursor
src/spatial/SpatialCursor.tsx - Gesture HUD
src/spatial/SpatialGestureHUD.tsx
Data and Utilities
- Architecture graph data
src/data/architectureGraphData.ts - Initial workspace and state
src/data/initialData.ts - Chat history service
src/services/indexedDbChatService.ts - HUD themes
src/utils/theme.ts - Sound effects
src/utils/audioEffects.ts
Other components
- Assistant user
Connections 28
- Assistant user → HUD and routing: uses
- HUD and routing → Command console: presents
src/App.tsx - HUD and routing → Architecture viewer: presents
src/App.tsx - HUD and routing → Task planning: presents
src/App.tsx - HUD and routing → Workspace files: presents
src/App.tsx - HUD and routing → Screen vision: presents
src/App.tsx - HUD and routing → Undo history: presents
src/App.tsx - HUD and routing → System controls: presents
src/App.tsx - HUD and routing → Memory dashboard: presents
src/App.tsx - HUD and routing → Skill plugins: presents
src/App.tsx - HUD and routing → Assistant settings: presents
src/App.tsx - HUD and routing → Assistant avatar: presents
src/App.tsx - HUD and routing → Initial workspace and state: loads
src/App.tsx - HUD and routing → Sound effects: plays
src/App.tsx - Architecture viewer → Graph canvas: renders
src/components/ArchitectureFlowDiagram.tsx - Architecture viewer → Architecture graph data: reads
src/components/ArchitectureFlowDiagram.tsx - Graph canvas → Architecture graph data: reads
src/components/ArchitectureGraphCanvas.tsx - Assistant settings → Voice discovery: includes
src/components/SettingsModal.tsx - Assistant settings → Spatial interaction controller: configures
src/components/SettingsModal.tsx - Spatial interaction controller → Camera lifecycle: controls
src/spatial/SpatialInteractionController.ts - Spatial interaction controller → Hand tracking: starts tracking
src/spatial/SpatialInteractionController.ts - Spatial interaction controller → Landmark processing: processes
src/spatial/SpatialInteractionController.ts - Spatial interaction controller → Gesture recognition: recognizes
src/spatial/SpatialInteractionController.ts - Spatial interaction controller → Gesture interpretation: interprets
src/spatial/SpatialInteractionController.ts - Spatial interaction controller → Interaction state: updates
src/spatial/SpatialInteractionController.ts - Spatial interaction controller → Sound effects: plays cue
src/spatial/SpatialInteractionController.ts - Spatial cursor → Spatial interaction controller: subscribes
src/spatial/SpatialCursor.tsx - Gesture HUD → Spatial interaction controller: subscribes
src/spatial/SpatialGestureHUD.tsx