How google-ai-edge/gallery works
Google AI Edge Gallery is an Android application for exploring on-device generative AI. Users choose or download a model, then use chat and task-specific experiences; outputs can include speech, media search results, transcriptions, or edited content. The repository tree shows shared agent/session and speech services alongside separate custom-task feature areas. The README documents several capabilities whose implementation details are not sampled here, so those branches are represented at their task-module paths. Connections not demonstrated by excerpts or explicit README statements are omitted or marked dashed and unverified.
Main entry points: AgentChatViewModel.kt Agent chat · SmartAlbumTask.kt Instant media search · TtsService.kt Speech synthesis · MainActivity.kt Android app
Components 22
App and models
- Android app
Android/src/app/src/main/java/com/google/ai/edge/gallery/MainActivity.kt - Model runtime
Android/src/app/src/main/java/com/google/ai/edge/gallery/runtime/LlmModelHelper.kt - Model downloads
Android/src/app/src/main/java/com/google/ai/edge/gallery/data/DownloadStorageManager.kt
Agent chat
- Agent chat
Android/src/app/src/main/java/com/google/ai/edge/gallery/customtasks/agentchat/AgentChatViewModel.kt - LLM sessions
Android/src/app/src/main/java/com/google/ai/edge/gallery/agent/sessions/DefaultLlmSessionManager.kt - Agent skills
Android/src/app/src/main/java/com/google/ai/edge/gallery/skills/SkillManager.kt - Agent tools
Android/src/app/src/main/java/com/google/ai/edge/gallery/customtasks/agentchat/AgentTools.kt
Speech services
- Speech recognition
Android/src/app/src/main/java/com/google/ai/edge/gallery/services/asr/AsrService.kt - Speech synthesis
Android/src/app/src/main/java/com/google/ai/edge/gallery/services/tts/TtsService.kt - MediaPipe TTS
Android/src/app/src/main/java/com/google/ai/edge/gallery/services/tts/MediaPipeTtsEngine.kt - Voice preview
Android/src/app/src/main/java/com/google/ai/edge/gallery/ui/modelmanager/VoicePreviewController.kt
Media experiences
- Instant media search
Android/src/app/src/main/java/com/google/ai/edge/gallery/customtasks/smartalbum/SmartAlbumTask.kt - Semantic retrieval
Android/src/app/src/main/java/com/google/ai/edge/gallery/services/semanticretrieval/SemanticRetrievalService.kt - Photo library
Android/src/app/src/main/java/com/google/ai/edge/gallery/services/photolibrary/PhotoLibraryService.kt - Video moment finder
Android/src/app/src/main/java/com/google/ai/edge/gallery/customtasks/videomomentfinder/VideoMomentFinderTask.kt
Other tasks
- XR language teacher
Android/src/app/src/main/java/com/google/ai/edge/gallery/customtasks/xrlanguageteacher/XrLanguageTeacherTask.kt - Mobile actions
Android/src/app/src/main/java/com/google/ai/edge/gallery/customtasks/mobileactions/MobileActionsTask.kt - Tiny Garden
Android/src/app/src/main/java/com/google/ai/edge/gallery/customtasks/tinygarden/TinyGardenTask.kt - Scrapbook editor
Android/src/app/src/main/java/com/google/ai/edge/gallery/customtasks/scrapbook/ScrapbookTask.kt - Ask Image and tasks
Android/src/app/src/main/java/com/google/ai/edge/gallery/customtasks/examplecustomtask/ExampleCustomTask.kt
Other components
- User
- Hugging Face
Connections 21
- User → Android app: opens
- Android app → Agent chat: offers
- User → Model downloads: manages models
- Model downloads → Hugging Face: discovers models
- Agent chat → LLM sessions: uses sessions
- Agent chat → Model runtime: runs prompts
- Agent chat → Agent skills: selects skills
- Agent chat → Agent tools: invokes tools
- Agent chat → Speech recognition: accepts speech
- Agent chat → Speech synthesis: speaks replies
- MediaPipe TTS → Speech synthesis: implements
Android/src/app/src/main/java/com/google/ai/edge/gallery/services/tts/MediaPipeTtsEngine.kt - Voice preview → Speech synthesis: previews voices
Android/src/app/src/main/java/com/google/ai/edge/gallery/ui/modelmanager/VoicePreviewController.kt - User → Instant media search: searches media
README.md - Instant media search → Semantic retrieval: retrieves matches
- Instant media search → Photo library: indexes photos
- User → Video moment finder: finds moments
README.md - User → XR language teacher: practices language
README.md - User → Mobile actions: requests actions
README.md - User → Tiny Garden: plays garden
README.md - User → Scrapbook editor: edits images
- User → Ask Image and tasks: asks about images
README.md