How micledson/screen2voice works
Screen 2 Voice is an Android accessibility app that captures the screen and speaks AI-generated image descriptions. The documented workflow begins when a user focuses an image: the accessibility service identifies it and invokes the orchestrator, which checks for a cached description or requests a screenshot, sends it to Gemini, stores the result, and speaks it. MainActivity handles accessibility and screen-capture permission setup. The source excerpts show these core calls and data transfers; other README-described setup behavior is represented only where supported.
Main entry points: Orchestrator.kt Description Orchestrator · ScreenCaptureService.kt Screen Capture Service · CaptureDao.kt Capture DAO · MainActivity.kt Permission Setup
Components 11
App Setup
- Permission Setup
app/src/main/java/com/micledson/screen2voice/MainActivity.kt
Image Capture
- Image Focus Detection
app/src/main/java/com/micledson/screen2voice/AccessibilityService.kt - Screen Capture Service
app/src/main/java/com/micledson/screen2voice/ScreenCaptureService.kt
Description Workflow
- Description Orchestrator
app/src/main/java/com/micledson/screen2voice/Orchestrator.kt - Gemini Image Request
app/src/main/java/com/micledson/screen2voice/ImageUploader.kt - Text To Speech
app/src/main/java/com/micledson/screen2voice/TextToSpeechHelper.kt
Description Cache
- Room Database
app/src/main/java/com/micledson/screen2voice/db/AppDatabase.kt - Capture DAO
app/src/main/java/com/micledson/screen2voice/db/dao/CaptureDao.kt - Capture Record
app/src/main/java/com/micledson/screen2voice/db/entity/Capture.kt
Other components
- User
- Gemini AI
Connections 13
- User → Permission Setup: starts service setup
Readme.md - Permission Setup → Screen Capture Service: starts capture
app/src/main/java/com/micledson/screen2voice/MainActivity.kt - User → Image Focus Detection: focuses image
Readme.md - Image Focus Detection → Description Orchestrator: executes for image
app/src/main/java/com/micledson/screen2voice/AccessibilityService.kt - Description Orchestrator → Room Database: opens database
app/src/main/java/com/micledson/screen2voice/Orchestrator.kt - Room Database → Capture DAO: provides DAO
app/src/main/java/com/micledson/screen2voice/db/AppDatabase.kt - Capture DAO → Capture Record: queries and inserts
app/src/main/java/com/micledson/screen2voice/db/dao/CaptureDao.kt - Description Orchestrator → Capture DAO: reads and stores descriptions
app/src/main/java/com/micledson/screen2voice/Orchestrator.kt - Description Orchestrator → Screen Capture Service: requests screenshot
app/src/main/java/com/micledson/screen2voice/Orchestrator.kt - Screen Capture Service → Description Orchestrator: broadcasts screenshot
app/src/main/java/com/micledson/screen2voice/ScreenCaptureService.kt - Description Orchestrator → Gemini Image Request: sends bitmap
app/src/main/java/com/micledson/screen2voice/Orchestrator.kt - Gemini Image Request → Gemini AI: requests description
app/src/main/java/com/micledson/screen2voice/ImageUploader.kt - Description Orchestrator → Text To Speech: speaks description
app/src/main/java/com/micledson/screen2voice/Orchestrator.kt