# micledson/screen2voice architecture

> Architecture diagram of the GitHub repository micledson/screen2voice, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-17). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/micledson/screen2voice
- Repository: https://github.com/micledson/screen2voice

## Overview

Screen 2 Voice is an Android accessibility app that captures the screen and speaks AI-generated image descriptions. The documented workflow begins when a user focuses an image: the accessibility service identifies it and invokes the orchestrator, which checks for a cached description or requests a screenshot, sends it to Gemini, stores the result, and speaks it. MainActivity handles accessibility and screen-capture permission setup. The source excerpts show these core calls and data transfers; other README-described setup behavior is represented only where supported.

Main entry points: [`app/src/main/java/com/micledson/screen2voice/Orchestrator.kt`](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/Orchestrator.kt) (Description Orchestrator), [`app/src/main/java/com/micledson/screen2voice/ScreenCaptureService.kt`](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/ScreenCaptureService.kt) (Screen Capture Service), [`app/src/main/java/com/micledson/screen2voice/db/dao/CaptureDao.kt`](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/db/dao/CaptureDao.kt) (Capture DAO), [`app/src/main/java/com/micledson/screen2voice/MainActivity.kt`](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/MainActivity.kt) (Permission Setup)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_setup["App Setup"]
  node_activity["Permission Setup<br/>[MainActivity.kt]"]
end

subgraph group_capture["Image Capture"]
  node_accessibility["Image Focus Detection"]
  node_screen_capture["Screen Capture Service"]
end

subgraph group_description["Description Workflow"]
  node_orchestrator["Description Orchestrator<br/>[Orchestrator.kt]"]
  node_uploader["Gemini Image Request<br/>[ImageUploader.kt]"]
  node_speech["Text To Speech"]
end

subgraph group_persistence["Description Cache"]
  node_room[("Room Database<br/>[AppDatabase.kt]")]
  node_dao["Capture DAO<br/>[CaptureDao.kt]"]
  node_capture_entity["Capture Record<br/>[Capture.kt]"]
end

node_user(("User"))
node_gemini{{"Gemini AI"}}

node_user -->|"starts service setup"| node_activity
node_activity -->|"starts capture"| node_screen_capture
node_user -->|"focuses image"| node_accessibility
node_accessibility -->|"executes for image"| node_orchestrator
node_orchestrator -->|"opens database"| node_room
node_room -->|"provides DAO"| node_dao
node_dao -->|"queries and inserts"| node_capture_entity
node_orchestrator -->|"reads and stores descriptions"| node_dao
node_orchestrator -->|"requests screenshot"| node_screen_capture
node_screen_capture -->|"broadcasts screenshot"| node_orchestrator
node_orchestrator -->|"sends bitmap"| node_uploader
node_uploader -->|"requests description"| node_gemini
node_orchestrator -->|"speaks description"| node_speech

click node_activity "https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/MainActivity.kt"
click node_accessibility "https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/AccessibilityService.kt"
click node_screen_capture "https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/ScreenCaptureService.kt"
click node_orchestrator "https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/Orchestrator.kt"
click node_uploader "https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/ImageUploader.kt"
click node_speech "https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/TextToSpeechHelper.kt"
click node_room "https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/db/AppDatabase.kt"
click node_dao "https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/db/dao/CaptureDao.kt"
click node_capture_entity "https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/db/entity/Capture.kt"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_activity,node_user toneBlue
class node_accessibility,node_screen_capture toneAmber
class node_orchestrator,node_uploader,node_speech toneMint
class node_room,node_dao,node_capture_entity toneRose
class node_gemini toneIndigo
```

## Components

### App Setup

- [Permission Setup](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/MainActivity.kt): `app/src/main/java/com/micledson/screen2voice/MainActivity.kt`

### Image Capture

- [Image Focus Detection](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/AccessibilityService.kt): `app/src/main/java/com/micledson/screen2voice/AccessibilityService.kt`
- [Screen Capture Service](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/ScreenCaptureService.kt): `app/src/main/java/com/micledson/screen2voice/ScreenCaptureService.kt`

### Description Workflow

- [Description Orchestrator](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/Orchestrator.kt): `app/src/main/java/com/micledson/screen2voice/Orchestrator.kt`
- [Gemini Image Request](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/ImageUploader.kt): `app/src/main/java/com/micledson/screen2voice/ImageUploader.kt`
- [Text To Speech](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/TextToSpeechHelper.kt): `app/src/main/java/com/micledson/screen2voice/TextToSpeechHelper.kt`

### Description Cache

- [Room Database](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/db/AppDatabase.kt): `app/src/main/java/com/micledson/screen2voice/db/AppDatabase.kt`
- [Capture DAO](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/db/dao/CaptureDao.kt): `app/src/main/java/com/micledson/screen2voice/db/dao/CaptureDao.kt`
- [Capture Record](https://github.com/micledson/screen2voice/blob/main/app/src/main/java/com/micledson/screen2voice/db/entity/Capture.kt): `app/src/main/java/com/micledson/screen2voice/db/entity/Capture.kt`

### Other components

- **User**
- **Gemini AI**

## Connections

- User → Permission Setup: starts service setup (evidence: `Readme.md`)
- Permission Setup → Screen Capture Service: starts capture (evidence: `app/src/main/java/com/micledson/screen2voice/MainActivity.kt`)
- User → Image Focus Detection: focuses image (evidence: `Readme.md`)
- Image Focus Detection → Description Orchestrator: executes for image (evidence: `app/src/main/java/com/micledson/screen2voice/AccessibilityService.kt`)
- Description Orchestrator → Room Database: opens database (evidence: `app/src/main/java/com/micledson/screen2voice/Orchestrator.kt`)
- Room Database → Capture DAO: provides DAO (evidence: `app/src/main/java/com/micledson/screen2voice/db/AppDatabase.kt`)
- Capture DAO → Capture Record: queries and inserts (evidence: `app/src/main/java/com/micledson/screen2voice/db/dao/CaptureDao.kt`)
- Description Orchestrator → Capture DAO: reads and stores descriptions (evidence: `app/src/main/java/com/micledson/screen2voice/Orchestrator.kt`)
- Description Orchestrator → Screen Capture Service: requests screenshot (evidence: `app/src/main/java/com/micledson/screen2voice/Orchestrator.kt`)
- Screen Capture Service → Description Orchestrator: broadcasts screenshot (evidence: `app/src/main/java/com/micledson/screen2voice/ScreenCaptureService.kt`)
- Description Orchestrator → Gemini Image Request: sends bitmap (evidence: `app/src/main/java/com/micledson/screen2voice/Orchestrator.kt`)
- Gemini Image Request → Gemini AI: requests description (evidence: `app/src/main/java/com/micledson/screen2voice/ImageUploader.kt`)
- Description Orchestrator → Text To Speech: speaks description (evidence: `app/src/main/java/com/micledson/screen2voice/Orchestrator.kt`)
