# jegly/offlinellm architecture

> Architecture diagram of the GitHub repository jegly/offlinellm, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-01). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/jegly/offlinellm
- Repository: https://github.com/jegly/offlinellm

## Overview

OfflineLLM is a private Android chat application that runs GGUF language models locally through llama.cpp, with optional Vulkan acceleration. Its main workflow is selecting or importing a model, configuring inference, sending chat turns, streaming generated text, and retaining conversations locally. The graph also preserves settings, security, presentation, and native inference capabilities documented in the README. Several UI and native-call relationships are not shown in the excerpts, so those links are omitted or marked unverified rather than inferred as confirmed calls.

Main entry points: [`app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt`](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt) (Model manager), [`app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt`](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt) (Chat repository), [`app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt`](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt) (Settings interface), [`app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt`](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt) (Settings logic)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_app["Android app"]
  node_activity["App entry<br/>[MainActivity.kt]"]
  node_settings_vm["Settings logic"]
  node_file_utils["Model file utilities<br/>[FileUtils.kt]"]
end

subgraph group_inference["Local inference"]
  node_model_manager["Model manager<br/>[ModelManager.kt]"]
  node_engine["Inference engine<br/>[InferenceEngine.kt]"]
  node_prompts["System prompts<br/>[SystemPrompts.kt]"]
  node_smollm["Kotlin JNI wrapper<br/>[SmolLM.kt]"]
  node_native["llama.cpp runtime<br/>[LLMInference.cpp]"]
  node_gguf["GGUF reader<br/>[GGUFReader.kt]"]
end

subgraph group_storage["Chat and settings data"]
  node_chat_repo["Chat repository<br/>[ChatRepository.kt]"]
  node_settings_repo["Settings storage"]
  node_database[("Room database<br/>[ChatDatabase.kt]")]
  node_conversation_dao["Conversation DAO<br/>[ConversationDao.kt]"]
  node_message_dao["Message DAO<br/>[MessageDao.kt]"]
  node_model_dao["Model DAO<br/>[ModelDao.kt]"]
  node_entities["Room entities<br/>[Conversation.kt]"]
end

subgraph group_experience["User experience"]
  node_navigation["Navigation<br/>[NavGraph.kt]"]
  node_chat["Chat interface<br/>[ChatScreen.kt]"]
  node_settings["Settings interface<br/>[SettingsScreen.kt]"]
  node_components["Chat components<br/>[MessageBubble.kt]"]
  node_tts["Speech output<br/>[TtsHelper.kt]"]
  node_themes["Themes and fonts<br/>[ThemeColors.kt]"]
end

node_user(("User"))

node_user -->|"opens app"| node_activity
node_activity -->|"hosts routes"| node_navigation
node_navigation -->|"routes to"| node_chat
node_navigation -->|"routes to"| node_settings
node_chat -.->|"requests inference"| node_model_manager
node_chat -.->|"loads and saves chats"| node_chat_repo
node_settings -->|"delegates settings"| node_settings_vm
node_settings -->|"shows prompt choices"| node_prompts
node_settings -->|"uses file tools"| node_file_utils
node_settings_vm -->|"manages models"| node_model_manager
node_settings_vm -->|"accesses models"| node_chat_repo
node_settings_vm -->|"reads settings"| node_settings_repo
node_model_manager -->|"registers models"| node_chat_repo
node_model_manager -->|"reads inference options"| node_settings_repo
node_model_manager -->|"reads model metadata"| node_gguf
node_model_manager -->|"loads model"| node_engine
node_engine -->|"loads and generates"| node_smollm
node_smollm -->|"calls JNI runtime"| node_native
node_chat_repo -->|"queries conversations"| node_conversation_dao
node_chat_repo -->|"queries messages"| node_message_dao
node_chat_repo -->|"queries models"| node_model_dao
node_database -->|"provides DAO"| node_conversation_dao
node_database -->|"provides DAO"| node_message_dao
node_database -->|"provides DAO"| node_model_dao
node_conversation_dao -->|"reads and writes"| node_entities
node_message_dao -->|"reads and writes"| node_entities
node_model_dao -->|"reads and writes"| node_entities
node_chat -.->|"renders messages"| node_components
node_components -.->|"reads aloud"| node_tts
node_user -->|"configures app"| node_settings

click node_activity "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/MainActivity.kt"
click node_navigation "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/navigation/NavGraph.kt"
click node_chat "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/screens/ChatScreen.kt"
click node_settings "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt"
click node_settings_vm "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt"
click node_model_manager "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt"
click node_engine "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ai/InferenceEngine.kt"
click node_prompts "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ai/SystemPrompts.kt"
click node_smollm "https://github.com/jegly/offlinellm/blob/main/smollm/src/main/java/com/jegly/offlineLLM/smollm/SmolLM.kt"
click node_native "https://github.com/jegly/offlinellm/blob/main/smollm/src/main/cpp/LLMInference.cpp"
click node_gguf "https://github.com/jegly/offlinellm/blob/main/smollm/src/main/java/com/jegly/offlineLLM/smollm/GGUFReader.kt"
click node_chat_repo "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt"
click node_settings_repo "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/repository/SettingsRepository.kt"
click node_database "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt"
click node_conversation_dao "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/dao/ConversationDao.kt"
click node_message_dao "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/dao/MessageDao.kt"
click node_model_dao "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/dao/ModelDao.kt"
click node_entities "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/entities/Conversation.kt"
click node_components "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/components/MessageBubble.kt"
click node_file_utils "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/utils/FileUtils.kt"
click node_tts "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/utils/TtsHelper.kt"
click node_themes "https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/theme/ThemeColors.kt"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_activity,node_settings_vm,node_file_utils,node_user toneBlue
class node_model_manager,node_engine,node_prompts,node_smollm,node_native,node_gguf toneAmber
class node_chat_repo,node_settings_repo,node_database,node_conversation_dao,node_message_dao,node_model_dao,node_entities toneMint
class node_navigation,node_chat,node_settings,node_components,node_tts,node_themes toneRose
```

## Components

### Android app

- [App entry](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/MainActivity.kt): `app/src/main/java/com/jegly/offlineLLM/MainActivity.kt`
- [Settings logic](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt): `app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt`
- [Model file utilities](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/utils/FileUtils.kt): `app/src/main/java/com/jegly/offlineLLM/utils/FileUtils.kt`

### Local inference

- [Model manager](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt): `app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt`
- [Inference engine](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ai/InferenceEngine.kt): `app/src/main/java/com/jegly/offlineLLM/ai/InferenceEngine.kt`
- [System prompts](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ai/SystemPrompts.kt): `app/src/main/java/com/jegly/offlineLLM/ai/SystemPrompts.kt`
- [Kotlin JNI wrapper](https://github.com/jegly/offlinellm/blob/main/smollm/src/main/java/com/jegly/offlineLLM/smollm/SmolLM.kt): `smollm/src/main/java/com/jegly/offlineLLM/smollm/SmolLM.kt`
- [llama.cpp runtime](https://github.com/jegly/offlinellm/blob/main/smollm/src/main/cpp/LLMInference.cpp): `smollm/src/main/cpp/LLMInference.cpp`
- [GGUF reader](https://github.com/jegly/offlinellm/blob/main/smollm/src/main/java/com/jegly/offlineLLM/smollm/GGUFReader.kt): `smollm/src/main/java/com/jegly/offlineLLM/smollm/GGUFReader.kt`

### Chat and settings data

- [Chat repository](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt): `app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt`
- [Settings storage](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/repository/SettingsRepository.kt): `app/src/main/java/com/jegly/offlineLLM/data/repository/SettingsRepository.kt`
- [Room database](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt): `app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt`
- [Conversation DAO](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/dao/ConversationDao.kt): `app/src/main/java/com/jegly/offlineLLM/data/local/dao/ConversationDao.kt`
- [Message DAO](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/dao/MessageDao.kt): `app/src/main/java/com/jegly/offlineLLM/data/local/dao/MessageDao.kt`
- [Model DAO](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/dao/ModelDao.kt): `app/src/main/java/com/jegly/offlineLLM/data/local/dao/ModelDao.kt`
- [Room entities](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/data/local/entities/Conversation.kt): `app/src/main/java/com/jegly/offlineLLM/data/local/entities/Conversation.kt`

### User experience

- [Navigation](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/navigation/NavGraph.kt): `app/src/main/java/com/jegly/offlineLLM/ui/navigation/NavGraph.kt`
- [Chat interface](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/screens/ChatScreen.kt): `app/src/main/java/com/jegly/offlineLLM/ui/screens/ChatScreen.kt`
- [Settings interface](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt): `app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt`
- [Chat components](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/components/MessageBubble.kt): `app/src/main/java/com/jegly/offlineLLM/ui/components/MessageBubble.kt`
- [Speech output](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/utils/TtsHelper.kt): `app/src/main/java/com/jegly/offlineLLM/utils/TtsHelper.kt`
- [Themes and fonts](https://github.com/jegly/offlinellm/blob/main/app/src/main/java/com/jegly/offlineLLM/ui/theme/ThemeColors.kt): `app/src/main/java/com/jegly/offlineLLM/ui/theme/ThemeColors.kt`

### Other components

- **User**

## Connections

- User → App entry: opens app (evidence: `README.md`)
- App entry → Navigation: hosts routes (evidence: `app/src/main/java/com/jegly/offlineLLM/MainActivity.kt`)
- Navigation → Chat interface: routes to (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/navigation/NavGraph.kt`)
- Navigation → Settings interface: routes to (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/navigation/NavGraph.kt`)
- Chat interface → Model manager: requests inference (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/screens/ChatScreen.kt`)
- Chat interface → Chat repository: loads and saves chats
- Settings interface → Settings logic: delegates settings (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt`)
- Settings interface → System prompts: shows prompt choices (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt`)
- Settings interface → Model file utilities: uses file tools (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsScreen.kt`)
- Settings logic → Model manager: manages models (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt`)
- Settings logic → Chat repository: accesses models (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt`)
- Settings logic → Settings storage: reads settings (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/screens/SettingsViewModel.kt`)
- Model manager → Chat repository: registers models (evidence: `app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt`)
- Model manager → Settings storage: reads inference options (evidence: `app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt`)
- Model manager → GGUF reader: reads model metadata (evidence: `app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt`)
- Model manager → Inference engine: loads model (evidence: `app/src/main/java/com/jegly/offlineLLM/ai/ModelManager.kt`)
- Inference engine → Kotlin JNI wrapper: loads and generates (evidence: `app/src/main/java/com/jegly/offlineLLM/ai/InferenceEngine.kt`)
- Kotlin JNI wrapper → llama.cpp runtime: calls JNI runtime (evidence: `smollm/src/main/java/com/jegly/offlineLLM/smollm/SmolLM.kt`)
- Chat repository → Conversation DAO: queries conversations (evidence: `app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt`)
- Chat repository → Message DAO: queries messages (evidence: `app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt`)
- Chat repository → Model DAO: queries models (evidence: `app/src/main/java/com/jegly/offlineLLM/data/repository/ChatRepository.kt`)
- Room database → Conversation DAO: provides DAO (evidence: `app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt`)
- Room database → Message DAO: provides DAO (evidence: `app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt`)
- Room database → Model DAO: provides DAO (evidence: `app/src/main/java/com/jegly/offlineLLM/data/local/ChatDatabase.kt`)
- Conversation DAO → Room entities: reads and writes (evidence: `app/src/main/java/com/jegly/offlineLLM/data/local/dao/ConversationDao.kt`)
- Message DAO → Room entities: reads and writes (evidence: `app/src/main/java/com/jegly/offlineLLM/data/local/dao/MessageDao.kt`)
- Model DAO → Room entities: reads and writes (evidence: `app/src/main/java/com/jegly/offlineLLM/data/local/dao/ModelDao.kt`)
- Chat interface → Chat components: renders messages (evidence: `app/src/main/java/com/jegly/offlineLLM/ui/screens/ChatScreen.kt`)
- Chat components → Speech output: reads aloud
- User → Settings interface: configures app (evidence: `README.md`)
