# lemonade-sdk/lemonade architecture

> Architecture diagram of the GitHub repository lemonade-sdk/lemonade, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-05). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/lemonade-sdk/lemonade
- Repository: https://github.com/lemonade-sdk/lemonade

## Overview

Lemonade is a local AI inference server with a desktop management and experimentation app, plus CLI and standard API clients. The principal workflow is selecting or downloading a model, preparing/loading it, sending a chat or multimodal request, and receiving generated output. The graph preserves model/backend management, custom collections and routing, and inference modalities. Runtime ownership is only partially visible in the supplied excerpts; unverified server-internal links are dashed rather than inferred as calls.

Main entry points: [`src/app/src/renderer/App.tsx`](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/App.tsx) (Desktop app), [`src/cpp/server/server.cpp`](https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/server.cpp) (Lemonade server), [`src/app/src/renderer/ModelManager.tsx`](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/ModelManager.tsx) (Model manager), [`src/cpp/server/router.cpp`](https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/router.cpp) (Inference router)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_client["Clients and desktop"]
  node_desktop["Desktop app<br/>[App.tsx]"]
  node_chat["Chat interface<br/>[LLMChatPanel.tsx]"]
  node_model_ui["Model manager<br/>[ModelManager.tsx]"]
  node_backend_ui["Backend manager<br/>[BackendManager.tsx]"]
  node_download_ui["Download manager"]
  node_cli["CLI<br/>[main.cpp]"]
  node_server_config["Server connection<br/>[serverConfig.ts]"]
end

subgraph group_models["Models and backends"]
  node_models_data["Model catalog data<br/>[modelData.ts]"]
  node_model_hooks["Model and system hooks<br/>[useModels.tsx]"]
  node_backend_installer["Model preparation"]
  node_download_tracking["Download tracking<br/>[downloadTracker.ts]"]
end

subgraph group_inference["Inference and routing"]
  node_collections["Collections and rules"]
  node_router_tree["Router rule model<br/>[routerTree.ts]"]
  node_router_ui["Router editor"]
  node_inference_ui["Multimodal panels"]
end

subgraph group_runtime["Server runtime"]
  node_server["Lemonade server<br/>[server.cpp]"]
  node_model_manager[("Model registry<br/>[model_manager.cpp]")]
  node_backend_manager["Backend orchestration"]
  node_router["Inference router<br/>[router.cpp]"]
  node_eviction["VRAM eviction"]
end

subgraph group_integrations["External interfaces"]
  node_api_clients(("API-compatible apps"))
  node_local_hardware{{"Local accelerators"}}
  node_cloud_providers{{"Cloud providers"}}
end

node_user(("User"))

node_user -->|"uses"| node_desktop
node_user -->|"runs commands"| node_cli
node_desktop -.->|"opens"| node_chat
node_desktop -.->|"manages models"| node_model_ui
node_desktop -.->|"manages backends"| node_backend_ui
node_desktop -.->|"tracks downloads"| node_download_ui
node_desktop -->|"configures routing"| node_router_ui
node_desktop -->|"offers generation"| node_inference_ui
node_model_ui -->|"reads catalog"| node_models_data
node_model_ui -->|"prepares models"| node_backend_installer
node_backend_ui -->|"reads system state"| node_model_hooks
node_download_ui -->|"tracks progress"| node_download_tracking
node_model_hooks -->|"loads catalog"| node_models_data
node_router_ui -->|"edits collections"| node_collections
node_router_ui -->|"edits rules"| node_router_tree
node_chat -->|"sends requests"| node_server_config
node_model_ui -->|"queries server"| node_server_config
node_server_config -.->|"connects API"| node_server
node_cli -->|"calls HTTP API"| node_server
node_api_clients -->|"uses compatible APIs"| node_server
node_server -.->|"manages models"| node_model_manager
node_server -.->|"coordinates backends"| node_backend_manager
node_server -.->|"dispatches inference"| node_router
node_router -.->|"runs models"| node_local_hardware
node_router -.->|"offloads inference"| node_cloud_providers
node_eviction -->|"evicts models"| node_router

click node_desktop "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/App.tsx"
click node_chat "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/components/panels/LLMChatPanel.tsx"
click node_model_ui "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/ModelManager.tsx"
click node_backend_ui "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/BackendManager.tsx"
click node_download_ui "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/DownloadManager.tsx"
click node_cli "https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/cli/main.cpp"
click node_models_data "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/modelData.ts"
click node_model_hooks "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/hooks/useModels.tsx"
click node_backend_installer "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/backendInstaller.ts"
click node_download_tracking "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/downloadTracker.ts"
click node_collections "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/customCollections.ts"
click node_router_tree "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/routerTree.ts"
click node_router_ui "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/components/RouterCollectionPanel.tsx"
click node_inference_ui "https://github.com/lemonade-sdk/lemonade/tree/main/src/app/src/renderer/components/panels"
click node_server_config "https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/serverConfig.ts"
click node_server "https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/server.cpp"
click node_model_manager "https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/model_manager.cpp"
click node_backend_manager "https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/backend_manager.cpp"
click node_router "https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/router.cpp"
click node_eviction "https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/eviction_engine.cpp"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_desktop,node_chat,node_model_ui,node_backend_ui,node_download_ui,node_cli,node_server_config,node_user toneBlue
class node_models_data,node_model_hooks,node_backend_installer,node_download_tracking toneAmber
class node_collections,node_router_tree,node_router_ui,node_inference_ui toneMint
class node_server,node_model_manager,node_backend_manager,node_router,node_eviction toneRose
class node_api_clients,node_local_hardware,node_cloud_providers toneIndigo
```

## Components

### Clients and desktop

- [Desktop app](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/App.tsx): `src/app/src/renderer/App.tsx`
- [Chat interface](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/components/panels/LLMChatPanel.tsx): `src/app/src/renderer/components/panels/LLMChatPanel.tsx`
- [Model manager](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/ModelManager.tsx): `src/app/src/renderer/ModelManager.tsx`
- [Backend manager](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/BackendManager.tsx): `src/app/src/renderer/BackendManager.tsx`
- [Download manager](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/DownloadManager.tsx): `src/app/src/renderer/DownloadManager.tsx`
- [CLI](https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/cli/main.cpp): `src/cpp/cli/main.cpp`
- [Server connection](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/serverConfig.ts): `src/app/src/renderer/utils/serverConfig.ts`

### Models and backends

- [Model catalog data](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/modelData.ts): `src/app/src/renderer/utils/modelData.ts`
- [Model and system hooks](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/hooks/useModels.tsx): `src/app/src/renderer/hooks/useModels.tsx`
- [Model preparation](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/backendInstaller.ts): `src/app/src/renderer/utils/backendInstaller.ts`
- [Download tracking](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/downloadTracker.ts): `src/app/src/renderer/utils/downloadTracker.ts`

### Inference and routing

- [Collections and rules](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/customCollections.ts): `src/app/src/renderer/utils/customCollections.ts`
- [Router rule model](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/utils/routerTree.ts): `src/app/src/renderer/utils/routerTree.ts`
- [Router editor](https://github.com/lemonade-sdk/lemonade/blob/main/src/app/src/renderer/components/RouterCollectionPanel.tsx): `src/app/src/renderer/components/RouterCollectionPanel.tsx`
- [Multimodal panels](https://github.com/lemonade-sdk/lemonade/tree/main/src/app/src/renderer/components/panels): `src/app/src/renderer/components/panels`

### Server runtime

- [Lemonade server](https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/server.cpp): `src/cpp/server/server.cpp`
- [Model registry](https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/model_manager.cpp): `src/cpp/server/model_manager.cpp`
- [Backend orchestration](https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/backend_manager.cpp): `src/cpp/server/backend_manager.cpp`
- [Inference router](https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/router.cpp): `src/cpp/server/router.cpp`
- [VRAM eviction](https://github.com/lemonade-sdk/lemonade/blob/main/src/cpp/server/eviction_engine.cpp): `src/cpp/server/eviction_engine.cpp`

### External interfaces

- **API-compatible apps**
- **Local accelerators**
- **Cloud providers**

### Other components

- **User**

## Connections

- User → Desktop app: uses (evidence: `README.md`)
- User → CLI: runs commands (evidence: `src/cpp/cli/main.cpp`)
- Desktop app → Chat interface: opens
- Desktop app → Model manager: manages models
- Desktop app → Backend manager: manages backends
- Desktop app → Download manager: tracks downloads
- Desktop app → Router editor: configures routing (evidence: `src/app/src/renderer/components/RouterCollectionPanel.tsx`)
- Desktop app → Multimodal panels: offers generation (evidence: `README.md`)
- Model manager → Model catalog data: reads catalog (evidence: `src/app/src/renderer/ModelManager.tsx`)
- Model manager → Model preparation: prepares models (evidence: `src/app/src/renderer/ModelManager.tsx`)
- Backend manager → Model and system hooks: reads system state (evidence: `src/app/src/renderer/BackendManager.tsx`)
- Download manager → Download tracking: tracks progress (evidence: `src/app/src/renderer/DownloadManager.tsx`)
- Model and system hooks → Model catalog data: loads catalog (evidence: `src/app/src/renderer/hooks/useModels.tsx`)
- Router editor → Collections and rules: edits collections (evidence: `src/app/src/renderer/components/RouterCollectionPanel.tsx`)
- Router editor → Router rule model: edits rules (evidence: `src/app/src/renderer/components/RouterCollectionPanel.tsx`)
- Chat interface → Server connection: sends requests (evidence: `src/app/src/renderer/components/panels/LLMChatPanel.tsx`)
- Model manager → Server connection: queries server (evidence: `src/app/src/renderer/ModelManager.tsx`)
- Server connection → Lemonade server: connects API
- CLI → Lemonade server: calls HTTP API (evidence: `src/cpp/cli/main.cpp`)
- API-compatible apps → Lemonade server: uses compatible APIs (evidence: `README.md`)
- Lemonade server → Model registry: manages models
- Lemonade server → Backend orchestration: coordinates backends
- Lemonade server → Inference router: dispatches inference
- Inference router → Local accelerators: runs models
- Inference router → Cloud providers: offloads inference
- VRAM eviction → Inference router: evicts models (evidence: `src/cpp/server/eviction_engine.cpp`)
