# manoloremiddi/augmentor-agent architecture

> Architecture diagram of the GitHub repository manoloremiddi/augmentor-agent, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-06). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/manoloremiddi/augmentor-agent
- Repository: https://github.com/manoloremiddi/augmentor-agent

## Overview

Augmentor Agent is a cross-platform desktop and Chromium-browser assistant that augments DSH and Pi agent sessions. The main workflow is a user composing or speaking a task in a surface, the selected harness handling the conversation and actions, and shared services supplying prompts, memory, and optional desktop capabilities. The repository also includes a Home service and an internal mobile remote preview. Relationship evidence is limited to README statements and indexed excerpts; unsampled implementation details are not inferred.

Main entry points: [`apps/native/augmentor_linux/controller.py`](https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/controller.py) (Desktop App), [`apps/browser/extension`](https://github.com/manoloremiddi/augmentor-agent/tree/main/apps/browser/extension) (Browser Extension), [`apps/native/augmentor_linux/voice.py`](https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/voice.py) (Voice Input), [`services/prompt-library/service.py`](https://github.com/manoloremiddi/augmentor-agent/blob/main/services/prompt-library/service.py) (Prompt Service)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_interfaces["User Interfaces"]
  node_desktop["Desktop App<br/>[controller.py]"]
  node_browser["Browser Extension"]
  node_mobile["Mobile Remote"]
  node_promptui["Prompt Library UI<br/>[prompt-library.mjs]"]
end

subgraph group_harness["Agent Harnesses"]
  node_pi["Pi Adapter<br/>[pi_client.py]"]
  node_dsh["DSH Adapter<br/>[actions.mjs]"]
  node_codex["Codex Adapter<br/>[codex.py]"]
end

subgraph group_capabilities["Shared Capabilities"]
  node_voice["Voice Input<br/>[voice.py]"]
  node_desktopcontrol["Desktop Control<br/>[service.py]"]
end

subgraph group_services["Local Services"]
  node_prompts["Prompt Service<br/>[service.py]"]
  node_promptdb[("Prompt Records<br/>[service.py]")]
  node_memory["Dual Memory<br/>[service.py]"]
  node_memorydb[("Memory Store<br/>[service.py]")]
  node_dictation["Dictation Broker<br/>[server.py]"]
  node_workspace[("Workspace Profiles<br/>[profiles.mjs]")]
  node_home["Home Service<br/>[server.mjs]"]
  node_browserembed["Browser Embed<br/>[server.mjs]"]
end

node_user(("User"))

node_user -->|"uses"| node_desktop
node_user -->|"uses"| node_browser
node_user -.->|"uses"| node_mobile
node_desktop -->|"dispatches"| node_pi
node_desktop -->|"dispatches"| node_dsh
node_desktop -->|"dispatches"| node_codex
node_browser -->|"supports"| node_dsh
node_browser -->|"supports subset"| node_pi
node_promptui -->|"shares records"| node_prompts
node_prompts -->|"stores"| node_promptdb
node_desktop -->|"offers"| node_voice
node_voice -.->|"uses broker"| node_dictation
node_desktop -->|"offers preview"| node_desktopcontrol
node_desktop -->|"uses optional memory"| node_memory
node_memory -->|"persists"| node_memorydb
node_desktop -.->|"uses profiles"| node_workspace
node_browserembed -->|"loads profile"| node_workspace
node_user -->|"pairs devices"| node_home

click node_desktop "https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/controller.py"
click node_browser "https://github.com/manoloremiddi/augmentor-agent/tree/main/apps/browser/extension"
click node_mobile "https://github.com/manoloremiddi/augmentor-agent/tree/main/apps/mobile"
click node_pi "https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/pi_client.py"
click node_dsh "https://github.com/manoloremiddi/augmentor-agent/blob/main/adapters/dsh-execution/actions.mjs"
click node_codex "https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/adapters/codex.py"
click node_promptui "https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/browser/extension/prompt-library.mjs"
click node_prompts "https://github.com/manoloremiddi/augmentor-agent/blob/main/services/prompt-library/service.py"
click node_promptdb "https://github.com/manoloremiddi/augmentor-agent/blob/main/services/prompt-library/service.py"
click node_memory "https://github.com/manoloremiddi/augmentor-agent/blob/main/services/memory/service.py"
click node_memorydb "https://github.com/manoloremiddi/augmentor-agent/blob/main/services/memory/service.py"
click node_voice "https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/voice.py"
click node_dictation "https://github.com/manoloremiddi/augmentor-agent/blob/main/services/dictation/server.py"
click node_desktopcontrol "https://github.com/manoloremiddi/augmentor-agent/blob/main/services/desktop/service.py"
click node_workspace "https://github.com/manoloremiddi/augmentor-agent/blob/main/services/workspaces/profiles.mjs"
click node_home "https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/home/server.mjs"
click node_browserembed "https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/browser/embed/server.mjs"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_desktop,node_browser,node_mobile,node_promptui,node_user toneBlue
class node_pi,node_dsh,node_codex toneAmber
class node_voice,node_desktopcontrol toneMint
class node_prompts,node_promptdb,node_memory,node_memorydb,node_dictation,node_workspace,node_home,node_browserembed toneRose
```

## Components

### User Interfaces

- [Desktop App](https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/controller.py): `apps/native/augmentor_linux/controller.py`
- [Browser Extension](https://github.com/manoloremiddi/augmentor-agent/tree/main/apps/browser/extension): `apps/browser/extension`
- [Mobile Remote](https://github.com/manoloremiddi/augmentor-agent/tree/main/apps/mobile): `apps/mobile`
- [Prompt Library UI](https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/browser/extension/prompt-library.mjs): `apps/browser/extension/prompt-library.mjs`

### Agent Harnesses

- [Pi Adapter](https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/pi_client.py): `apps/native/augmentor_linux/pi_client.py`
- [DSH Adapter](https://github.com/manoloremiddi/augmentor-agent/blob/main/adapters/dsh-execution/actions.mjs): `adapters/dsh-execution/actions.mjs`
- [Codex Adapter](https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/adapters/codex.py): `apps/native/augmentor_linux/adapters/codex.py`

### Shared Capabilities

- [Voice Input](https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/native/augmentor_linux/voice.py): `apps/native/augmentor_linux/voice.py`
- [Desktop Control](https://github.com/manoloremiddi/augmentor-agent/blob/main/services/desktop/service.py): `services/desktop/service.py`

### Local Services

- [Prompt Service](https://github.com/manoloremiddi/augmentor-agent/blob/main/services/prompt-library/service.py): `services/prompt-library/service.py`
- [Prompt Records](https://github.com/manoloremiddi/augmentor-agent/blob/main/services/prompt-library/service.py): `services/prompt-library/service.py`
- [Dual Memory](https://github.com/manoloremiddi/augmentor-agent/blob/main/services/memory/service.py): `services/memory/service.py`
- [Memory Store](https://github.com/manoloremiddi/augmentor-agent/blob/main/services/memory/service.py): `services/memory/service.py`
- [Dictation Broker](https://github.com/manoloremiddi/augmentor-agent/blob/main/services/dictation/server.py): `services/dictation/server.py`
- [Workspace Profiles](https://github.com/manoloremiddi/augmentor-agent/blob/main/services/workspaces/profiles.mjs): `services/workspaces/profiles.mjs`
- [Home Service](https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/home/server.mjs): `apps/home/server.mjs`
- [Browser Embed](https://github.com/manoloremiddi/augmentor-agent/blob/main/apps/browser/embed/server.mjs): `apps/browser/embed/server.mjs`

### Other components

- **User**

## Connections

- User → Desktop App: uses (evidence: `README.md`)
- User → Browser Extension: uses (evidence: `README.md`)
- User → Mobile Remote: uses (evidence: `README.md`)
- Desktop App → Pi Adapter: dispatches (evidence: `apps/native/augmentor_linux/controller.py`)
- Desktop App → DSH Adapter: dispatches (evidence: `apps/native/augmentor_linux/controller.py`)
- Desktop App → Codex Adapter: dispatches (evidence: `apps/native/augmentor_linux/controller.py`)
- Browser Extension → DSH Adapter: supports (evidence: `README.md`)
- Browser Extension → Pi Adapter: supports subset (evidence: `README.md`)
- Prompt Library UI → Prompt Service: shares records (evidence: `README.md`)
- Prompt Service → Prompt Records: stores (evidence: `services/prompt-library/service.py`)
- Desktop App → Voice Input: offers (evidence: `README.md`)
- Voice Input → Dictation Broker: uses broker
- Desktop App → Desktop Control: offers preview (evidence: `README.md`)
- Desktop App → Dual Memory: uses optional memory (evidence: `README.md`)
- Dual Memory → Memory Store: persists (evidence: `services/memory/service.py`)
- Desktop App → Workspace Profiles: uses profiles
- Browser Embed → Workspace Profiles: loads profile (evidence: `apps/browser/embed/server.mjs`)
- User → Home Service: pairs devices (evidence: `README.md`)
