How jegly/offlinellm works
OfflineLLM is a private Android chat application that runs GGUF language models locally through llama.cpp, with optional Vulkan acceleration. Its main workflow is selecting or importing a model, configuring inference, sending chat turns, streaming generated text, and retaining conversations locally. The graph also preserves settings, security, presentation, and native inference capabilities documented in the README. Several UI and native-call relationships are not shown in the excerpts, so those links are omitted or marked unverified rather than inferred as confirmed calls.
Main entry points: ModelManager.kt Model manager · ChatRepository.kt Chat repository · SettingsScreen.kt Settings interface · SettingsViewModel.kt Settings logic
Components 23
Android app
- App entry
app/src/main/java/com/jegly/offlineLLM/MainActivity.kt - Settings logic
app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt - Model file utilities
app/src/main/java/com/jegly/offlineLLM/utils/FileUtils.kt
Local inference
- Model manager
app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt - Inference engine
app/src/main/java/com/jegly/offlineLLM/ai/InferenceEngine.kt - System prompts
app/src/main/java/com/jegly/offlineLLM/ai/SystemPrompts.kt - Kotlin JNI wrapper
smollm/src/main/java/com/jegly/offlineLLM/smollm/SmolLM.kt - llama.cpp runtime
smollm/src/main/cpp/LLMInference.cpp - GGUF reader
smollm/src/main/java/com/jegly/offlineLLM/smollm/GGUFReader.kt
Chat and settings data
- Chat repository
app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt - Settings storage
app/src/main/java/com/jegly/offlineLLM/data/repository/SettingsRepository.kt - Room database
app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt - Conversation DAO
app/src/main/java/com/jegly/offlineLLM/data/local/dao/ConversationDao.kt - Message DAO
app/src/main/java/com/jegly/offlineLLM/data/local/dao/MessageDao.kt - Model DAO
app/src/main/java/com/jegly/offlineLLM/data/local/dao/ModelDao.kt - Room entities
app/src/main/java/com/jegly/offlineLLM/data/local/entities/Conversation.kt
User experience
- Navigation
app/src/main/java/com/jegly/offlineLLM/ui/navigation/NavGraph.kt - Chat interface
app/src/main/java/com/jegly/offlineLLM/ui/screens/ChatScreen.kt - Settings interface
app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt - Chat components
app/src/main/java/com/jegly/offlineLLM/ui/components/MessageBubble.kt - Speech output
app/src/main/java/com/jegly/offlineLLM/utils/TtsHelper.kt - Themes and fonts
app/src/main/java/com/jegly/offlineLLM/ui/theme/ThemeColors.kt
Other components
- User
Connections 30
- User → App entry: opens app
README.md - App entry → Navigation: hosts routes
app/src/main/java/com/jegly/offlineLLM/MainActivity.kt - Navigation → Chat interface: routes to
app/src/main/java/com/jegly/offlineLLM/ui/navigation/NavGraph.kt - Navigation → Settings interface: routes to
app/src/main/java/com/jegly/offlineLLM/ui/navigation/NavGraph.kt - Chat interface → Model manager: requests inference
app/src/main/java/com/jegly/offlineLLM/ui/screens/ChatScreen.kt - Chat interface → Chat repository: loads and saves chats
- Settings interface → Settings logic: delegates settings
app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt - Settings interface → System prompts: shows prompt choices
app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt - Settings interface → Model file utilities: uses file tools
app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt - Settings logic → Model manager: manages models
app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt - Settings logic → Chat repository: accesses models
app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt - Settings logic → Settings storage: reads settings
app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt - Model manager → Chat repository: registers models
app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt - Model manager → Settings storage: reads inference options
app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt - Model manager → GGUF reader: reads model metadata
app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt - Model manager → Inference engine: loads model
app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt - Inference engine → Kotlin JNI wrapper: loads and generates
app/src/main/java/com/jegly/offlineLLM/ai/InferenceEngine.kt - Kotlin JNI wrapper → llama.cpp runtime: calls JNI runtime
smollm/src/main/java/com/jegly/offlineLLM/smollm/SmolLM.kt - Chat repository → Conversation DAO: queries conversations
app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt - Chat repository → Message DAO: queries messages
app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt - Chat repository → Model DAO: queries models
app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt - Room database → Conversation DAO: provides DAO
app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt - Room database → Message DAO: provides DAO
app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt - Room database → Model DAO: provides DAO
app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt - Conversation DAO → Room entities: reads and writes
app/src/main/java/com/jegly/offlineLLM/data/local/dao/ConversationDao.kt - Message DAO → Room entities: reads and writes
app/src/main/java/com/jegly/offlineLLM/data/local/dao/MessageDao.kt - Model DAO → Room entities: reads and writes
app/src/main/java/com/jegly/offlineLLM/data/local/dao/ModelDao.kt - Chat interface → Chat components: renders messages
app/src/main/java/com/jegly/offlineLLM/ui/screens/ChatScreen.kt - Chat components → Speech output: reads aloud
- User → Settings interface: configures app
README.md