# brunogpj/jarvis-ai-os architecture

> Architecture diagram of the GitHub repository brunogpj/jarvis-ai-os, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-17). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/brunogpj/jarvis-ai-os
- Repository: https://github.com/brunogpj/jarvis-ai-os

## Overview

Jarvis is a personal AI assistant: people send requests through web chat or WhatsApp, the agent routes them to Gemini and domain tools, and results can be returned as text or spoken on Android. The README also describes hybrid RAG, an actionable dashboard, scheduled autonomy, multimodal processing, and human-approved WhatsApp replies. The tree includes a native Android companion despite the README’s older claim that there is no native app. Edges use README statements or indexed/excerpted Android references; unsampled internals are not assumed to call one another.

Main entry points: [`Jarvis.js`](https://github.com/brunogpj/jarvis-ai-os/blob/master/Jarvis.js) (Agent loop), [`SkillsManager.js`](https://github.com/brunogpj/jarvis-ai-os/blob/master/SkillsManager.js) (Tool registry), [`android/app/src/main/java/dev/jarvis/companion/Api.kt`](https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/Api.kt) (Server API client), [`WhatsApp.js`](https://github.com/brunogpj/jarvis-ai-os/blob/master/WhatsApp.js) (WhatsApp)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_interfaces["User interfaces"]
  node_web["Web chat<br/>[Jarvis.js]"]
  node_wa["WhatsApp<br/>[WhatsApp.js]"]
end

subgraph group_agent["Agent and memory"]
  node_agentcore["Agent loop<br/>[Jarvis.js]"]
  node_intent["Intent routing<br/>[Semantica.js]"]
  node_gemini["Gemini models<br/>[Gemini.js]"]
  node_rag["Hybrid RAG<br/>[FileSearchDrive.js]"]
  node_wiki["Wiki memory"]
  node_firestore[("Cloud Firestore<br/>[Firestore.js]")]
  node_skills["Tool registry<br/>[SkillsManager.js]"]
end

subgraph group_capabilities["Domain capabilities"]
  node_gmail["Gmail tools<br/>[Gmail.js]"]
  node_agenda["Calendar tools<br/>[Agenda.js]"]
  node_drive["Drive search<br/>[FileSearchDrive.js]"]
  node_finance["Finance tools<br/>[Financas.js]"]
  node_multimodal["Media processing<br/>[Midia.js]"]
end

subgraph group_operations["Automation and safety"]
  node_async["Async broker<br/>[AsyncBroker.js]"]
  node_jobs["Scheduled jobs<br/>[Jobs.js]"]
  node_objectives["Goal autonomy<br/>[Objetivos.js]"]
  node_authorization["Human approval<br/>[Autorizacoes.js]"]
  node_safety["Security controls<br/>[Sandbox.js]"]
end

subgraph group_android["Android companion"]
  node_androidapp["Android companion<br/>[MainActivity.kt]"]
  node_androidapi["Server API client<br/>[Api.kt]"]
  node_androidvoice["Voice service<br/>[FalaService.kt]"]
  node_androidchat["Voice conversation<br/>[Conversa.kt]"]
  node_push["Push dispatcher"]
  node_ack["Ack queue<br/>[AckQueue.kt]"]
  node_notifications["Notification listener"]
  node_dashboard["Action dashboard<br/>[Historico.kt]"]
end

node_person(("User"))

node_person -->|"sends request"| node_web
node_person -->|"sends message"| node_wa
node_web -->|"submits request"| node_agentcore
node_wa -->|"submits request"| node_agentcore
node_agentcore -->|"routes intent"| node_intent
node_intent -->|"searches first"| node_rag
node_agentcore -->|"calls model"| node_gemini
node_agentcore -->|"dispatches tools"| node_skills
node_skills -->|"dispatches tool"| node_gmail
node_skills -->|"dispatches tool"| node_agenda
node_skills -->|"dispatches tool"| node_drive
node_skills -->|"dispatches tool"| node_finance
node_rag -->|"retrieves memory"| node_wiki
node_wiki -->|"stores memory"| node_firestore
node_agentcore -->|"queues heavy work"| node_async
node_jobs -.->|"runs background work"| node_async
node_objectives -->|"executes in background"| node_async
node_wa -->|"requests approval"| node_authorization
node_agentcore -->|"guards execution"| node_safety
node_agentcore -->|"processes media"| node_multimodal
node_person -->|"uses companion"| node_androidapp
node_androidapp -->|"posts requests"| node_androidapi
node_androidapi -->|"calls Apps Script"| node_agentcore
node_push -->|"starts service"| node_androidvoice
node_androidvoice -->|"asks assistant"| node_androidchat
node_push -->|"queues acknowledgments"| node_ack
node_ack -->|"posts acknowledgments"| node_androidapi
node_notifications -->|"loads configuration"| node_androidapi
node_dashboard -->|"fetches dashboard"| node_androidapi

click node_web "https://github.com/brunogpj/jarvis-ai-os/blob/master/Jarvis.js"
click node_wa "https://github.com/brunogpj/jarvis-ai-os/blob/master/WhatsApp.js"
click node_agentcore "https://github.com/brunogpj/jarvis-ai-os/blob/master/Jarvis.js"
click node_intent "https://github.com/brunogpj/jarvis-ai-os/blob/master/Semantica.js"
click node_gemini "https://github.com/brunogpj/jarvis-ai-os/blob/master/Gemini.js"
click node_rag "https://github.com/brunogpj/jarvis-ai-os/blob/master/FileSearchDrive.js"
click node_wiki "https://github.com/brunogpj/jarvis-ai-os/blob/master/WikiMemoryService.js"
click node_firestore "https://github.com/brunogpj/jarvis-ai-os/blob/master/Firestore.js"
click node_skills "https://github.com/brunogpj/jarvis-ai-os/blob/master/SkillsManager.js"
click node_gmail "https://github.com/brunogpj/jarvis-ai-os/blob/master/Gmail.js"
click node_agenda "https://github.com/brunogpj/jarvis-ai-os/blob/master/Agenda.js"
click node_drive "https://github.com/brunogpj/jarvis-ai-os/blob/master/FileSearchDrive.js"
click node_finance "https://github.com/brunogpj/jarvis-ai-os/blob/master/Financas.js"
click node_multimodal "https://github.com/brunogpj/jarvis-ai-os/blob/master/Midia.js"
click node_async "https://github.com/brunogpj/jarvis-ai-os/blob/master/AsyncBroker.js"
click node_jobs "https://github.com/brunogpj/jarvis-ai-os/blob/master/Jobs.js"
click node_objectives "https://github.com/brunogpj/jarvis-ai-os/blob/master/Objetivos.js"
click node_authorization "https://github.com/brunogpj/jarvis-ai-os/blob/master/Autorizacoes.js"
click node_safety "https://github.com/brunogpj/jarvis-ai-os/blob/master/Sandbox.js"
click node_androidapp "https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/MainActivity.kt"
click node_androidapi "https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/Api.kt"
click node_androidvoice "https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/FalaService.kt"
click node_androidchat "https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/Conversa.kt"
click node_push "https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/JarvisMessagingService.kt"
click node_ack "https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/AckQueue.kt"
click node_notifications "https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/NotificacaoService.kt"
click node_dashboard "https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/Historico.kt"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_web,node_wa,node_person toneBlue
class node_agentcore,node_intent,node_gemini,node_rag,node_wiki,node_firestore,node_skills toneAmber
class node_gmail,node_agenda,node_drive,node_finance,node_multimodal toneMint
class node_async,node_jobs,node_objectives,node_authorization,node_safety toneRose
class node_androidapp,node_androidapi,node_androidvoice,node_androidchat,node_push,node_ack,node_notifications,node_dashboard toneIndigo
```

## Components

### User interfaces

- [Web chat](https://github.com/brunogpj/jarvis-ai-os/blob/master/Jarvis.js): `Jarvis.js`
- [WhatsApp](https://github.com/brunogpj/jarvis-ai-os/blob/master/WhatsApp.js): `WhatsApp.js`

### Agent and memory

- [Agent loop](https://github.com/brunogpj/jarvis-ai-os/blob/master/Jarvis.js): `Jarvis.js`
- [Intent routing](https://github.com/brunogpj/jarvis-ai-os/blob/master/Semantica.js): `Semantica.js`
- [Gemini models](https://github.com/brunogpj/jarvis-ai-os/blob/master/Gemini.js): `Gemini.js`
- [Hybrid RAG](https://github.com/brunogpj/jarvis-ai-os/blob/master/FileSearchDrive.js): `FileSearchDrive.js`
- [Wiki memory](https://github.com/brunogpj/jarvis-ai-os/blob/master/WikiMemoryService.js): `WikiMemoryService.js`
- [Cloud Firestore](https://github.com/brunogpj/jarvis-ai-os/blob/master/Firestore.js): `Firestore.js`
- [Tool registry](https://github.com/brunogpj/jarvis-ai-os/blob/master/SkillsManager.js): `SkillsManager.js`

### Domain capabilities

- [Gmail tools](https://github.com/brunogpj/jarvis-ai-os/blob/master/Gmail.js): `Gmail.js`
- [Calendar tools](https://github.com/brunogpj/jarvis-ai-os/blob/master/Agenda.js): `Agenda.js`
- [Drive search](https://github.com/brunogpj/jarvis-ai-os/blob/master/FileSearchDrive.js): `FileSearchDrive.js`
- [Finance tools](https://github.com/brunogpj/jarvis-ai-os/blob/master/Financas.js): `Financas.js`
- [Media processing](https://github.com/brunogpj/jarvis-ai-os/blob/master/Midia.js): `Midia.js`

### Automation and safety

- [Async broker](https://github.com/brunogpj/jarvis-ai-os/blob/master/AsyncBroker.js): `AsyncBroker.js`
- [Scheduled jobs](https://github.com/brunogpj/jarvis-ai-os/blob/master/Jobs.js): `Jobs.js`
- [Goal autonomy](https://github.com/brunogpj/jarvis-ai-os/blob/master/Objetivos.js): `Objetivos.js`
- [Human approval](https://github.com/brunogpj/jarvis-ai-os/blob/master/Autorizacoes.js): `Autorizacoes.js`
- [Security controls](https://github.com/brunogpj/jarvis-ai-os/blob/master/Sandbox.js): `Sandbox.js`

### Android companion

- [Android companion](https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/MainActivity.kt): `android/app/src/main/java/dev/jarvis/companion/MainActivity.kt`
- [Server API client](https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/Api.kt): `android/app/src/main/java/dev/jarvis/companion/Api.kt`
- [Voice service](https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/FalaService.kt): `android/app/src/main/java/dev/jarvis/companion/FalaService.kt`
- [Voice conversation](https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/Conversa.kt): `android/app/src/main/java/dev/jarvis/companion/Conversa.kt`
- [Push dispatcher](https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/JarvisMessagingService.kt): `android/app/src/main/java/dev/jarvis/companion/JarvisMessagingService.kt`
- [Ack queue](https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/AckQueue.kt): `android/app/src/main/java/dev/jarvis/companion/AckQueue.kt`
- [Notification listener](https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/NotificacaoService.kt): `android/app/src/main/java/dev/jarvis/companion/NotificacaoService.kt`
- [Action dashboard](https://github.com/brunogpj/jarvis-ai-os/blob/master/android/app/src/main/java/dev/jarvis/companion/Historico.kt): `android/app/src/main/java/dev/jarvis/companion/Historico.kt`

### Other components

- **User**

## Connections

- User → Web chat: sends request (evidence: `README.md`)
- User → WhatsApp: sends message (evidence: `README.md`)
- Web chat → Agent loop: submits request (evidence: `README.md`)
- WhatsApp → Agent loop: submits request (evidence: `README.md`)
- Agent loop → Intent routing: routes intent (evidence: `README.md`)
- Intent routing → Hybrid RAG: searches first (evidence: `README.md`)
- Agent loop → Gemini models: calls model (evidence: `README.md`)
- Agent loop → Tool registry: dispatches tools (evidence: `README.md`)
- Tool registry → Gmail tools: dispatches tool (evidence: `README.md`)
- Tool registry → Calendar tools: dispatches tool (evidence: `README.md`)
- Tool registry → Drive search: dispatches tool (evidence: `README.md`)
- Tool registry → Finance tools: dispatches tool (evidence: `README.md`)
- Hybrid RAG → Wiki memory: retrieves memory (evidence: `README.md`)
- Wiki memory → Cloud Firestore: stores memory (evidence: `README.md`)
- Agent loop → Async broker: queues heavy work (evidence: `README.md`)
- Scheduled jobs → Async broker: runs background work
- Goal autonomy → Async broker: executes in background (evidence: `README.md`)
- WhatsApp → Human approval: requests approval (evidence: `README.md`)
- Agent loop → Security controls: guards execution (evidence: `README.md`)
- Agent loop → Media processing: processes media (evidence: `README.md`)
- User → Android companion: uses companion (evidence: `README.md`)
- Android companion → Server API client: posts requests (evidence: `android/app/src/main/java/dev/jarvis/companion/MainActivity.kt`)
- Server API client → Agent loop: calls Apps Script (evidence: `README.md`)
- Push dispatcher → Voice service: starts service (evidence: `android/app/src/main/java/dev/jarvis/companion/JarvisMessagingService.kt`)
- Voice service → Voice conversation: asks assistant (evidence: `android/app/src/main/java/dev/jarvis/companion/FalaService.kt`)
- Push dispatcher → Ack queue: queues acknowledgments (evidence: `android/app/src/main/java/dev/jarvis/companion/JarvisMessagingService.kt`)
- Ack queue → Server API client: posts acknowledgments (evidence: `android/app/src/main/java/dev/jarvis/companion/AckQueue.kt`)
- Notification listener → Server API client: loads configuration (evidence: `android/app/src/main/java/dev/jarvis/companion/NotificacaoService.kt`)
- Action dashboard → Server API client: fetches dashboard (evidence: `android/app/src/main/java/dev/jarvis/companion/Historico.kt`)
