# niranjanmari-m/jarvis architecture

> Architecture diagram of the GitHub repository niranjanmari-m/jarvis, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-06). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/niranjanmari-m/jarvis
- Repository: https://github.com/niranjanmari-m/jarvis

## Overview

Agentic Jarvis is a local-first, multi-device AI assistant. Users submit requests through the assistant or management dashboard; the brain coordinates reasoning and task execution, while connected PC and Android agents provide device actions. The repository also includes documented capabilities for memory, vision, voice, messaging, security, learning, and integrations. The graph combines sampled relationships with README-documented product areas; links between unsampled subsystems are omitted where their runtime wiring is not shown.

Main entry points: [`agentic_brain/core/brain.py`](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/brain.py) (Brain orchestration), [`agentic_brain/hub/websocket_server.py`](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/hub/websocket_server.py) (WebSocket hub), [`android_kotlin/app/src/main/java/com/jarvis/service/JarvisAccessibilityService.kt`](https://github.com/niranjanmari-m/jarvis/blob/main/android_kotlin/app/src/main/java/com/jarvis/service/JarvisAccessibilityService.kt) (Android agent), [`agentic_brain/core/decision_engine.py`](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/decision_engine.py) (Event decisions)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_assistant["Assistant runtime"]
  node_brain["Brain orchestration<br/>[brain.py]"]
  node_decision["Event decisions<br/>[decision_engine.py]"]
  node_executor["Task execution<br/>[task_executor.py]"]
  node_research["Background research"]
end

subgraph group_intelligence["Intelligence and memory"]
  node_llm["Ollama models"]
  node_memory[("Memory services")]
  node_cognition["Cognition and learning"]
  node_vision["Screen understanding"]
end

subgraph group_devices["Device control"]
  node_laptop["Laptop agent<br/>[agent.py]"]
  node_android["Android agent"]
  node_protocol["Device protocol<br/>[protocol.py]"]
  node_hub["WebSocket hub"]
end

subgraph group_management["Management and integrations"]
  node_security["Permissions and privacy"]
  node_messaging["Cross-device messaging"]
  node_management_api["Management API<br/>[management_api.py]"]
  node_integrations["Plugins and connectors"]
end

subgraph group_interaction["User interaction"]
  node_voice["Voice interaction<br/>[voice_engine.py]"]
  node_dashboard["Dashboard interface<br/>[app.js]"]
  node_api_client["Dashboard API client<br/>[api.js]"]
end

node_user(("User"))

node_user -.->|"requests assistance"| node_brain
node_brain -->|"routes events"| node_decision
node_brain -.->|"dispatches tasks"| node_executor
node_decision -.->|"enriches context"| node_memory
node_decision -.->|"starts research"| node_research
node_research -->|"searches web"| node_brain
node_brain -.->|"uses models"| node_llm
node_brain -.->|"supports thinking"| node_cognition
node_brain -->|"analyzes screens"| node_vision
node_user -.->|"manages assistant"| node_dashboard
node_dashboard -->|"calls"| node_api_client
node_api_client -->|"requests management"| node_management_api
node_management_api -->|"configures extensions"| node_integrations
node_management_api -->|"gates installs"| node_security
node_brain -.->|"communicates devices"| node_hub
node_hub -->|"uses messages"| node_protocol
node_android -.->|"exchanges messages"| node_protocol
node_android -.->|"connects by socket"| node_hub
node_laptop -.->|"connects by socket"| node_hub
node_android -.->|"provides screen capture"| node_vision
node_brain -.->|"supports messaging"| node_messaging
node_brain -.->|"speaks responses"| node_voice

click node_brain "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/brain.py"
click node_decision "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/decision_engine.py"
click node_executor "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/task_executor.py"
click node_research "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/orchestrator/research_handler.py"
click node_llm "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/llm/ollama_interface.py"
click node_memory "https://github.com/niranjanmari-m/jarvis/tree/main/agentic_brain/memory"
click node_cognition "https://github.com/niranjanmari-m/jarvis/tree/main/agentic_brain/cognition"
click node_vision "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/vision/vision_processor.py"
click node_voice "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/voice/voice_engine.py"
click node_laptop "https://github.com/niranjanmari-m/jarvis/blob/main/laptop_agent/agent.py"
click node_android "https://github.com/niranjanmari-m/jarvis/blob/main/android_kotlin/app/src/main/java/com/jarvis/service/JarvisAccessibilityService.kt"
click node_protocol "https://github.com/niranjanmari-m/jarvis/blob/main/shared/protocol.py"
click node_hub "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/hub/websocket_server.py"
click node_security "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/security/permission_system.py"
click node_messaging "https://github.com/niranjanmari-m/jarvis/tree/main/agentic_brain/messaging"
click node_dashboard "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/api/dashboard/js/app.js"
click node_api_client "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/api/dashboard/js/api.js"
click node_management_api "https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/api/management_api.py"
click node_integrations "https://github.com/niranjanmari-m/jarvis/tree/main/agentic_brain/connectors"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_brain,node_decision,node_executor,node_research,node_user toneBlue
class node_llm,node_memory,node_cognition,node_vision toneAmber
class node_laptop,node_android,node_protocol,node_hub toneMint
class node_security,node_messaging,node_management_api,node_integrations toneRose
class node_voice,node_dashboard,node_api_client toneIndigo
```

## Components

### Assistant runtime

- [Brain orchestration](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/brain.py): `agentic_brain/core/brain.py`
- [Event decisions](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/decision_engine.py): `agentic_brain/core/decision_engine.py`
- [Task execution](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/task_executor.py): `agentic_brain/core/task_executor.py`
- [Background research](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/core/orchestrator/research_handler.py): `agentic_brain/core/orchestrator/research_handler.py`

### Intelligence and memory

- [Ollama models](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/llm/ollama_interface.py): `agentic_brain/llm/ollama_interface.py`
- [Memory services](https://github.com/niranjanmari-m/jarvis/tree/main/agentic_brain/memory): `agentic_brain/memory`
- [Cognition and learning](https://github.com/niranjanmari-m/jarvis/tree/main/agentic_brain/cognition): `agentic_brain/cognition`
- [Screen understanding](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/vision/vision_processor.py): `agentic_brain/vision/vision_processor.py`

### Device control

- [Laptop agent](https://github.com/niranjanmari-m/jarvis/blob/main/laptop_agent/agent.py): `laptop_agent/agent.py`
- [Android agent](https://github.com/niranjanmari-m/jarvis/blob/main/android_kotlin/app/src/main/java/com/jarvis/service/JarvisAccessibilityService.kt): `android_kotlin/app/src/main/java/com/jarvis/service/JarvisAccessibilityService.kt`
- [Device protocol](https://github.com/niranjanmari-m/jarvis/blob/main/shared/protocol.py): `shared/protocol.py`
- [WebSocket hub](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/hub/websocket_server.py): `agentic_brain/hub/websocket_server.py`

### Management and integrations

- [Permissions and privacy](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/security/permission_system.py): `agentic_brain/security/permission_system.py`
- [Cross-device messaging](https://github.com/niranjanmari-m/jarvis/tree/main/agentic_brain/messaging): `agentic_brain/messaging`
- [Management API](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/api/management_api.py): `agentic_brain/api/management_api.py`
- [Plugins and connectors](https://github.com/niranjanmari-m/jarvis/tree/main/agentic_brain/connectors): `agentic_brain/connectors`

### User interaction

- [Voice interaction](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/voice/voice_engine.py): `agentic_brain/voice/voice_engine.py`
- [Dashboard interface](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/api/dashboard/js/app.js): `agentic_brain/api/dashboard/js/app.js`
- [Dashboard API client](https://github.com/niranjanmari-m/jarvis/blob/main/agentic_brain/api/dashboard/js/api.js): `agentic_brain/api/dashboard/js/api.js`

### Other components

- **User**

## Connections

- User → Brain orchestration: requests assistance
- Brain orchestration → Event decisions: routes events (evidence: `agentic_brain/main.py`)
- Brain orchestration → Task execution: dispatches tasks
- Event decisions → Memory services: enriches context (evidence: `agentic_brain/core/decision_engine.py`)
- Event decisions → Background research: starts research (evidence: `agentic_brain/core/orchestrator/research_handler.py`)
- Background research → Brain orchestration: searches web (evidence: `agentic_brain/core/orchestrator/research_handler.py`)
- Brain orchestration → Ollama models: uses models
- Brain orchestration → Cognition and learning: supports thinking
- Brain orchestration → Screen understanding: analyzes screens (evidence: `agentic_brain/main.py`)
- User → Dashboard interface: manages assistant
- Dashboard interface → Dashboard API client: calls (evidence: `agentic_brain/api/dashboard/js/app.js`)
- Dashboard API client → Management API: requests management (evidence: `agentic_brain/api/dashboard/js/api.js`)
- Management API → Plugins and connectors: configures extensions
- Management API → Permissions and privacy: gates installs
- Brain orchestration → WebSocket hub: communicates devices
- WebSocket hub → Device protocol: uses messages (evidence: `agentic_brain/hub/websocket_server.py`)
- Android agent → Device protocol: exchanges messages
- Android agent → WebSocket hub: connects by socket
- Laptop agent → WebSocket hub: connects by socket
- Android agent → Screen understanding: provides screen capture
- Brain orchestration → Cross-device messaging: supports messaging
- Brain orchestration → Voice interaction: speaks responses
