How niranjanmari-m/jarvis works
Agentic Jarvis is a local-first, multi-device AI assistant. Users submit requests through the assistant or management dashboard; the brain coordinates reasoning and task execution, while connected PC and Android agents provide device actions. The repository also includes documented capabilities for memory, vision, voice, messaging, security, learning, and integrations. The graph combines sampled relationships with README-documented product areas; links between unsampled subsystems are omitted where their runtime wiring is not shown.
Main entry points: brain.py Brain orchestration · websocket_server.py WebSocket hub · JarvisAccessibilityService.kt Android agent · decision_engine.py Event decisions
Components 20
Assistant runtime
- Brain orchestration
agentic_brain/core/brain.py - Event decisions
agentic_brain/core/decision_engine.py - Task execution
agentic_brain/core/task_executor.py - Background research
agentic_brain/core/orchestrator/research_handler.py
Intelligence and memory
- Ollama models
agentic_brain/llm/ollama_interface.py - Memory services
agentic_brain/memory - Cognition and learning
agentic_brain/cognition - Screen understanding
agentic_brain/vision/vision_processor.py
Device control
- Laptop agent
laptop_agent/agent.py - Android agent
android_kotlin/app/src/main/java/com/jarvis/service/JarvisAccessibilityService.kt - Device protocol
shared/protocol.py - WebSocket hub
agentic_brain/hub/websocket_server.py
Management and integrations
- Permissions and privacy
agentic_brain/security/permission_system.py - Cross-device messaging
agentic_brain/messaging - Management API
agentic_brain/api/management_api.py - Plugins and connectors
agentic_brain/connectors
User interaction
- Voice interaction
agentic_brain/voice/voice_engine.py - Dashboard interface
agentic_brain/api/dashboard/js/app.js - Dashboard API client
agentic_brain/api/dashboard/js/api.js
Other components
- User
Connections 22
- User → Brain orchestration: requests assistance
- Brain orchestration → Event decisions: routes events
agentic_brain/main.py - Brain orchestration → Task execution: dispatches tasks
- Event decisions → Memory services: enriches context
agentic_brain/core/decision_engine.py - Event decisions → Background research: starts research
agentic_brain/core/orchestrator/research_handler.py - Background research → Brain orchestration: searches web
agentic_brain/core/orchestrator/research_handler.py - Brain orchestration → Ollama models: uses models
- Brain orchestration → Cognition and learning: supports thinking
- Brain orchestration → Screen understanding: analyzes screens
agentic_brain/main.py - User → Dashboard interface: manages assistant
- Dashboard interface → Dashboard API client: calls
agentic_brain/api/dashboard/js/app.js - Dashboard API client → Management API: requests management
agentic_brain/api/dashboard/js/api.js - Management API → Plugins and connectors: configures extensions
- Management API → Permissions and privacy: gates installs
- Brain orchestration → WebSocket hub: communicates devices
- WebSocket hub → Device protocol: uses messages
agentic_brain/hub/websocket_server.py - Android agent → Device protocol: exchanges messages
- Android agent → WebSocket hub: connects by socket
- Laptop agent → WebSocket hub: connects by socket
- Android agent → Screen understanding: provides screen capture
- Brain orchestration → Cross-device messaging: supports messaging
- Brain orchestration → Voice interaction: speaks responses