# dinesh210805/aura-android-use architecture

> Architecture diagram of the GitHub repository dinesh210805/aura-android-use, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-03). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/dinesh210805/aura-android-use
- Repository: https://github.com/dinesh210805/aura-android-use

## Overview

AURA is an Android assistant that lets a person or an external MCP client operate real phone apps. The principal workflow is request intake (voice, text, or live conversation), agent planning with a selected LLM, guarded tool execution, screen reading and accessibility actions, then verification and response. The app also exposes a LAN MCP server, with an optional desktop connector, and includes persistent memory and skill support. Relationships below follow the README’s documented architecture; unsampled implementation details are not inferred.

Main entry points: [`aura-android/app/src/main/java/com/aura/aura_ui/agent/AuraAgent.kt`](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/AuraAgent.kt) (On-device agent), [`aura-android/app/src/main/java/com/aura/aura_ui/accessibility/AuraAccessibilityService.kt`](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/accessibility/AuraAccessibilityService.kt) (Accessibility service), [`aura-android/mcp-server/src/main/kotlin/com/aura/mcp/McpServerController.kt`](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/mcp-server/src/main/kotlin/com/aura/mcp/McpServerController.kt) (Phone MCP server), [`aura-android/app/src/main/java/com/aura/aura_ui/agent/mcpbridge/ActionGuard.kt`](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/mcpbridge/ActionGuard.kt) (Tool safety gate)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_experience["Phone experience"]
  node_main_activity["App entry<br/>[MainActivity.kt]"]
  node_conversation["Conversation UI"]
  node_voice["Voice capture"]
  node_live_conversation["Live conversation"]
  node_overlay["Assistant overlay"]
end

subgraph group_agent["Agent runtime"]
  node_agent["On-device agent<br/>[AuraAgent.kt]"]
  node_llm_catalog["LLM providers"]
  node_tool_safety["Tool safety gate<br/>[ActionGuard.kt]"]
  node_skills["Agent skills<br/>[SkillManager.kt]"]
  node_proof["Completion checks<br/>[CompletionGate.kt]"]
end

subgraph group_device["Phone interaction"]
  node_accessibility["Accessibility service"]
  node_screen_reading["Screen perception<br/>[UITreeExtractor.kt]"]
  node_gesture["Gesture execution"]
end

subgraph group_mcp["MCP access"]
  node_phone_mcp["Phone MCP server"]
  node_mcp_tools["Phone tool bridges"]
  node_connector["Desktop connector<br/>[index.js]"]
end

subgraph group_support["Context and memory"]
  node_memory[("Agent memory<br/>[MemoryService.kt]")]
  node_memory_store[("Encrypted memory store")]
end

node_person(("Phone user"))
node_computer_client(("Computer MCP client"))

node_person -->|"asks by text"| node_conversation
node_person -->|"speaks request"| node_voice
node_person -->|"starts conversation"| node_live_conversation
node_conversation -->|"hands off task"| node_agent
node_voice -->|"sends transcript"| node_agent
node_live_conversation -->|"calls ask_aura"| node_agent
node_main_activity -.->|"starts assistant"| node_overlay
node_overlay -->|"runs task"| node_agent
node_agent -->|"requests next step"| node_llm_catalog
node_agent -->|"submits tool call"| node_tool_safety
node_agent -.->|"uses skills"| node_skills
node_tool_safety -->|"permits device action"| node_accessibility
node_accessibility -->|"reads screen"| node_screen_reading
node_accessibility -->|"dispatches actions"| node_gesture
node_agent -.->|"checks completion"| node_proof
node_computer_client -->|"sends MCP requests"| node_connector
node_connector -->|"connects over LAN"| node_phone_mcp
node_phone_mcp -->|"gates tool calls"| node_tool_safety
node_phone_mcp -.->|"dispatches tools"| node_mcp_tools
node_agent -.->|"uses remembered context"| node_memory
node_memory -.->|"persists data"| node_memory_store
node_agent -.->|"returns result"| node_person

click node_main_activity "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/MainActivity.kt"
click node_conversation "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/conversation/ConversationViewModel.kt"
click node_voice "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/voice/VoiceCaptureController.kt"
click node_live_conversation "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/conversation/CompanionLiveController.kt"
click node_overlay "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/overlay/AuraOverlayService.kt"
click node_agent "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/AuraAgent.kt"
click node_llm_catalog "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/llm/LlmEndpointCatalog.kt"
click node_tool_safety "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/mcpbridge/ActionGuard.kt"
click node_skills "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/skills/SkillManager.kt"
click node_proof "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/proof/CompletionGate.kt"
click node_accessibility "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/accessibility/AuraAccessibilityService.kt"
click node_screen_reading "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/accessibility/UITreeExtractor.kt"
click node_gesture "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/accessibility/gesture/GestureDispatcher.kt"
click node_phone_mcp "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/mcp-server/src/main/kotlin/com/aura/mcp/McpServerController.kt"
click node_mcp_tools "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/mcp-server/src/main/kotlin/com/aura/mcp/tools/PerceiveScreenTool.kt"
click node_connector "https://github.com/dinesh210805/aura-android-use/blob/main/aura-mcp-connect/src/index.js"
click node_memory "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/memory/MemoryService.kt"
click node_memory_store "https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/memory/EncryptedJsonStore.kt"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_main_activity,node_conversation,node_voice,node_live_conversation,node_overlay,node_person,node_computer_client toneBlue
class node_agent,node_llm_catalog,node_tool_safety,node_skills,node_proof toneAmber
class node_accessibility,node_screen_reading,node_gesture toneMint
class node_phone_mcp,node_mcp_tools,node_connector toneRose
class node_memory,node_memory_store toneIndigo
```

## Components

### Phone experience

- [App entry](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/MainActivity.kt): `aura-android/app/src/main/java/com/aura/aura_ui/MainActivity.kt`
- [Conversation UI](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/conversation/ConversationViewModel.kt): `aura-android/app/src/main/java/com/aura/aura_ui/conversation/ConversationViewModel.kt`
- [Voice capture](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/voice/VoiceCaptureController.kt): `aura-android/app/src/main/java/com/aura/aura_ui/voice/VoiceCaptureController.kt`
- [Live conversation](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/conversation/CompanionLiveController.kt): `aura-android/app/src/main/java/com/aura/aura_ui/agent/conversation/CompanionLiveController.kt`
- [Assistant overlay](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/overlay/AuraOverlayService.kt): `aura-android/app/src/main/java/com/aura/aura_ui/overlay/AuraOverlayService.kt`

### Agent runtime

- [On-device agent](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/AuraAgent.kt): `aura-android/app/src/main/java/com/aura/aura_ui/agent/AuraAgent.kt`
- [LLM providers](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/llm/LlmEndpointCatalog.kt): `aura-android/app/src/main/java/com/aura/aura_ui/agent/llm/LlmEndpointCatalog.kt`
- [Tool safety gate](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/mcpbridge/ActionGuard.kt): `aura-android/app/src/main/java/com/aura/aura_ui/agent/mcpbridge/ActionGuard.kt`
- [Agent skills](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/skills/SkillManager.kt): `aura-android/app/src/main/java/com/aura/aura_ui/agent/skills/SkillManager.kt`
- [Completion checks](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/proof/CompletionGate.kt): `aura-android/app/src/main/java/com/aura/aura_ui/agent/proof/CompletionGate.kt`

### Phone interaction

- [Accessibility service](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/accessibility/AuraAccessibilityService.kt): `aura-android/app/src/main/java/com/aura/aura_ui/accessibility/AuraAccessibilityService.kt`
- [Screen perception](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/accessibility/UITreeExtractor.kt): `aura-android/app/src/main/java/com/aura/aura_ui/accessibility/UITreeExtractor.kt`
- [Gesture execution](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/accessibility/gesture/GestureDispatcher.kt): `aura-android/app/src/main/java/com/aura/aura_ui/accessibility/gesture/GestureDispatcher.kt`

### MCP access

- [Phone MCP server](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/mcp-server/src/main/kotlin/com/aura/mcp/McpServerController.kt): `aura-android/mcp-server/src/main/kotlin/com/aura/mcp/McpServerController.kt`
- [Phone tool bridges](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/mcp-server/src/main/kotlin/com/aura/mcp/tools/PerceiveScreenTool.kt): `aura-android/mcp-server/src/main/kotlin/com/aura/mcp/tools/PerceiveScreenTool.kt`
- [Desktop connector](https://github.com/dinesh210805/aura-android-use/blob/main/aura-mcp-connect/src/index.js): `aura-mcp-connect/src/index.js`

### Context and memory

- [Agent memory](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/memory/MemoryService.kt): `aura-android/app/src/main/java/com/aura/aura_ui/agent/memory/MemoryService.kt`
- [Encrypted memory store](https://github.com/dinesh210805/aura-android-use/blob/main/aura-android/app/src/main/java/com/aura/aura_ui/agent/memory/EncryptedJsonStore.kt): `aura-android/app/src/main/java/com/aura/aura_ui/agent/memory/EncryptedJsonStore.kt`

### Other components

- **Phone user**
- **Computer MCP client**

## Connections

- Phone user → Conversation UI: asks by text
- Phone user → Voice capture: speaks request
- Phone user → Live conversation: starts conversation
- Conversation UI → On-device agent: hands off task
- Voice capture → On-device agent: sends transcript
- Live conversation → On-device agent: calls ask_aura
- App entry → Assistant overlay: starts assistant (evidence: `aura-android/app/src/main/java/com/aura/aura_ui/MainActivity.kt`)
- Assistant overlay → On-device agent: runs task (evidence: `aura-android/app/src/main/java/com/aura/aura_ui/overlay/AuraOverlayService.kt`)
- On-device agent → LLM providers: requests next step (evidence: `aura-android/app/src/main/java/com/aura/aura_ui/agent/AuraAgent.kt`)
- On-device agent → Tool safety gate: submits tool call
- On-device agent → Agent skills: uses skills
- Tool safety gate → Accessibility service: permits device action
- Accessibility service → Screen perception: reads screen (evidence: `aura-android/app/src/main/java/com/aura/aura_ui/accessibility/AuraAccessibilityService.kt`)
- Accessibility service → Gesture execution: dispatches actions
- On-device agent → Completion checks: checks completion
- Computer MCP client → Desktop connector: sends MCP requests
- Desktop connector → Phone MCP server: connects over LAN
- Phone MCP server → Tool safety gate: gates tool calls
- Phone MCP server → Phone tool bridges: dispatches tools
- On-device agent → Agent memory: uses remembered context
- Agent memory → Encrypted memory store: persists data (evidence: `aura-android/app/src/main/java/com/aura/aura_ui/agent/memory/MemoryService.kt`)
- On-device agent → Phone user: returns result
