How timmyy123/llm-hub works
LLM Hub is a cross-platform mobile app for private, primarily on-device AI chat and media tools. The main user journey is to download or import a model, select it, then chat; chat can draw on RAG memory, web search, and speech features. Android source exposes chat, inference, embedding/RAG, model management, agent, and generation modules; the README documents additional iOS and tool capabilities whose implementation is not sampled. Edges use README statements where code-level wiring was not shown, so they describe documented product flow rather than verified calls.
Main entry points: ChatViewModel.kt Chat workflow · InferenceService.kt Inference service · AgentViewModel.kt AI agent · ChatScreen.kt Chat screen
Components 28
App experience
- App navigation
android/app/src/main/java/com/llmhub/llmhub/navigation/LlmHubNavigation.kt - Chat screen
android/app/src/main/java/com/llmhub/llmhub/screens/ChatScreen.kt - Chat workflow
android/app/src/main/java/com/llmhub/llmhub/viewmodels/ChatViewModel.kt - Chat history
android/app/src/main/java/com/llmhub/llmhub/repository/ChatRepository.kt - App database
android/app/src/main/java/com/llmhub/llmhub/data/LlmHubDatabase.kt
Models and inference
- Model catalog
android/app/src/main/java/com/llmhub/llmhub/data/ModelData.kt - Model downloads
android/app/src/main/java/com/llmhub/llmhub/data/ModelDownloader.kt - Model repository
android/app/src/main/java/com/llmhub/llmhub/data/ModelRepository.kt - Inference service
android/app/src/main/java/com/llmhub/llmhub/inference/InferenceService.kt - LiteRT inference
android/app/src/main/java/com/llmhub/llmhub/inference/LiteRtLmInferenceService.kt - Llama inference
android/app/src/main/java/com/llmhub/llmhub/inference/LlamaCppInferenceService.kt - ONNX inference
android/app/src/main/java/com/llmhub/llmhub/inference/OnnxInferenceService.kt
Chat context
- RAG retrieval
android/app/src/main/java/com/llmhub/llmhub/embedding/RagService.kt - Embeddings
android/app/src/main/java/com/llmhub/llmhub/embedding/EmbeddingService.kt - Web search
android/app/src/main/java/com/llmhub/llmhub/websearch/WebSearchService.kt
AI tools
- AI agent
android/app/src/main/java/com/llmhub/llmhub/agent/AgentViewModel.kt - Agent tools
android/app/src/main/java/com/llmhub/llmhub/agent/AgentToolSet.kt - Termux bridge
android/app/src/main/java/com/llmhub/llmhub/agent/TermuxCommandBridge.kt - Image generation
android/app/src/main/java/com/llmhub/llmhub/imagegen/ImageGeneratorHelper.kt - Music generation
android/app/src/main/java/com/llmhub/llmhub/data/MusicGeneratorBackend.kt - Other AI tools
android/app/src/main/java/com/llmhub/llmhub/screens
Platform runtimes
- iOS RAG manager
ios/LLMHub/Sources/LLMHub/RagServiceManager.swift - iOS music runtime
ios/LLMHub/LocalPackages/magenta-runtime/Sources/MagentaRuntime/MagentaRealtimeEngine.swift - LiteRT-LM engine
ios/LLMHub/LocalPackages/LiteRT-LM/swift/Engine.swift - iOS runtime SDK
ios/LLMHub/LocalPackages/RunAnywhereBinaries/RACommons.xcframework/ios-arm64/Headers/rac/features/llm/rac_llm_service.h
Other components
- Mobile user
- Model providers
- Termux service
Connections 27
- Mobile user → App navigation: opens tools
README.md - App navigation → Chat screen: opens chat
- Mobile user → Model downloads: downloads or imports
README.md - Model downloads → Model catalog: selects model
- Mobile user → Chat screen: starts chatting
README.md - Chat screen → Chat workflow: submits prompt
- Chat workflow → Inference service: requests response
- Chat workflow → Chat history: saves conversations
- Chat history → App database: persists history
- Inference service → LiteRT inference: uses backend
android/app/src/main/java/com/llmhub/llmhub/inference/LiteRtLmInferenceService.kt - Inference service → Llama inference: uses backend
android/app/src/main/java/com/llmhub/llmhub/inference/LlamaCppInferenceService.kt - Inference service → ONNX inference: uses backend
android/app/src/main/java/com/llmhub/llmhub/inference/OnnxInferenceService.kt - Chat workflow → RAG retrieval: uses memory
README.md - RAG retrieval → Embeddings: retrieves embeddings
android/app/src/main/java/com/llmhub/llmhub/embedding/RagService.kt - Chat workflow → Web search: uses web search
README.md - Mobile user → AI agent: runs agent
README.md - AI agent → Agent tools: invokes tools
README.md - AI agent → Termux bridge: runs commands
README.md - Termux bridge → Termux service: sends intent
README.md - Mobile user → Image generation: creates images
README.md - Mobile user → Music generation: generates music
README.md - Mobile user → Other AI tools: uses AI tools
README.md - Mobile user → iOS RAG manager: uses RAG
- Mobile user → iOS music runtime: generates music
README.md - Mobile user → LiteRT-LM engine: runs local models
- Mobile user → iOS runtime SDK: runs local models
README.md - Model catalog → Model providers: downloads models
README.md