# jhanroenz/vision-os architecture

> Architecture diagram of the GitHub repository jhanroenz/vision-os, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-10-02). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/jhanroenz/vision-os
- Repository: https://github.com/jhanroenz/vision-os

## Overview

VisionOS is a desktop AI environment combining a SvelteKit interface, Jarvis backend, and Tauri shell. The main workflow is a user interacting with desktop apps, sending work through API routes to backend capabilities, and receiving results; persistent settings, conversations, and workspace data support that work. Research and user-app creation are distinct product branches, with user apps published into My Apps. Edges use README architecture statements and indexed source references; unsampled implementation details are omitted or marked unverified rather than inferred.

Main entry points: [`src/routes/api`](https://github.com/jhanroenz/vision-os/tree/main/src/routes/api) (API routes), [`src/lib/components/apps/UserAppsManagerApp.svelte`](https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/apps/UserAppsManagerApp.svelte) (My Apps), [`src/lib/server/agent.js`](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/agent.js) (Jarvis agent), [`src/lib/server/userApps/sdkHandler.js`](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/userApps/sdkHandler.js) (App SDK handler)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_desktop["Desktop experience"]
  node_tauri["Tauri shell<br/>[lib.rs]"]
  node_desktopui["Desktop UI<br/>[+page.svelte]"]
  node_settingsui["LLM settings"]
  node_settingsfield["Settings fields"]
  node_researchui["Research app<br/>[ResearchApp.svelte]"]
  node_wallpapers["Wallpaper catalog<br/>[catalog.ts]"]
  node_wallpaperengine["Wallpaper renderer<br/>[engine.ts]"]
end

subgraph group_agent["Agent services"]
  node_agent["Jarvis agent<br/>[agent.js]"]
  node_llm["LLM providers<br/>[llmProviders.js]"]
  node_workspace["Workspace services<br/>[workspace.js]"]
  node_websearch["Web search policy<br/>[webSearchPolicy.js]"]
  node_engines["Search engines<br/>[searxngEngines.js]"]
  node_searxng["SearXNG runtime<br/>[lib.mjs]"]
end

subgraph group_research["Research"]
  node_researchflow["Research workflow<br/>[orchestrator.js]"]
  node_researchplan["Query planning<br/>[queryGenerator.js]"]
  node_researchmemory[("Research memory<br/>[sessionMemory.js]")]
end

subgraph group_apps["User apps"]
  node_userappui["My Apps"]
  node_userhost["User app host<br/>[UserAppHost.svelte]"]
  node_sdk["App SDK handler<br/>[sdkHandler.js]"]
  node_apprepo[("App repository<br/>[repository.js]")]
  node_permissions["App permissions<br/>[permissions.js]"]
  node_jobs["App jobs<br/>[jobRunner.js]"]
end

subgraph group_runtime["Runtime and state"]
  node_backend["Backend process<br/>[backend.rs]"]
  node_api["API routes"]
  node_settingsdb[("Settings persistence<br/>[appSettingsDb.js]")]
  node_db[("SQLite database<br/>[db.js]")]
  node_config["Runtime config<br/>[config.js]"]
  node_paths["Path resolution<br/>[paths.js]"]
end

node_person(("User"))

node_person -->|"uses"| node_desktopui
node_tauri -->|"starts"| node_backend
node_backend -->|"serves UI"| node_desktopui
node_desktopui -->|"requests"| node_api
node_settingsui -->|"renders"| node_settingsfield
node_person -->|"configures"| node_settingsui
node_api -.->|"dispatches"| node_agent
node_agent -.->|"uses"| node_llm
node_agent -.->|"uses"| node_workspace
node_agent -.->|"uses"| node_websearch
node_websearch -->|"reads usage"| node_engines
node_engines -->|"reads policy"| node_websearch
node_person -->|"requests research"| node_researchui
node_researchui -->|"requests"| node_api
node_api -.->|"dispatches"| node_researchflow
node_researchflow -.->|"plans queries"| node_researchplan
node_researchplan -->|"suggests follow-ups"| node_researchmemory
node_researchflow -.->|"searches web"| node_websearch
node_person -->|"manages apps"| node_userappui
node_userappui -.->|"requests"| node_api
node_userappui -.->|"opens apps"| node_userhost
node_userhost -.->|"calls SDK"| node_sdk
node_sdk -->|"reads and writes"| node_apprepo
node_sdk -->|"checks access"| node_permissions
node_sdk -->|"runs jobs"| node_jobs
node_userappui -->|"builds in"| node_workspace
node_userappui -->|"publishes through"| node_api
node_settingsui -.->|"saves settings"| node_api
node_db -->|"reads configuration"| node_config
node_db -->|"migrates settings"| node_settingsdb
node_config -->|"resolves directories"| node_paths
node_wallpaperengine -->|"uses catalog"| node_wallpapers

click node_tauri "https://github.com/jhanroenz/vision-os/blob/main/src-tauri/src/lib.rs"
click node_backend "https://github.com/jhanroenz/vision-os/blob/main/src-tauri/src/backend.rs"
click node_desktopui "https://github.com/jhanroenz/vision-os/blob/main/src/routes/%2Bpage.svelte"
click node_api "https://github.com/jhanroenz/vision-os/tree/main/src/routes/api"
click node_settingsui "https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/settings/LlmSettingsSection.svelte"
click node_settingsfield "https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/settings/SettingsField.svelte"
click node_agent "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/agent.js"
click node_llm "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/llmProviders.js"
click node_workspace "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/workspace.js"
click node_websearch "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/webSearchPolicy.js"
click node_engines "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/searxngEngines.js"
click node_searxng "https://github.com/jhanroenz/vision-os/blob/main/searxng/lib.mjs"
click node_researchui "https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/apps/ResearchApp.svelte"
click node_researchflow "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/deepResearch/orchestrator.js"
click node_researchplan "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/deepResearch/queryGenerator.js"
click node_researchmemory "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/deepResearch/sessionMemory.js"
click node_userappui "https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/apps/UserAppsManagerApp.svelte"
click node_userhost "https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/apps/UserAppHost.svelte"
click node_sdk "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/userApps/sdkHandler.js"
click node_apprepo "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/userApps/repository.js"
click node_permissions "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/userApps/permissions.js"
click node_jobs "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/userApps/jobRunner.js"
click node_settingsdb "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/appSettingsDb.js"
click node_db "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/db.js"
click node_config "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/config.js"
click node_paths "https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/paths.js"
click node_wallpapers "https://github.com/jhanroenz/vision-os/blob/main/src/lib/wallpapers/catalog.ts"
click node_wallpaperengine "https://github.com/jhanroenz/vision-os/blob/main/src/lib/wallpapers/engine.ts"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_tauri,node_desktopui,node_settingsui,node_settingsfield,node_researchui,node_wallpapers,node_wallpaperengine,node_person toneBlue
class node_agent,node_llm,node_workspace,node_websearch,node_engines,node_searxng toneAmber
class node_researchflow,node_researchplan,node_researchmemory toneMint
class node_userappui,node_userhost,node_sdk,node_apprepo,node_permissions,node_jobs toneRose
class node_backend,node_api,node_settingsdb,node_db,node_config,node_paths toneIndigo
```

## Components

### Desktop experience

- [Tauri shell](https://github.com/jhanroenz/vision-os/blob/main/src-tauri/src/lib.rs): `src-tauri/src/lib.rs`
- [Desktop UI](https://github.com/jhanroenz/vision-os/blob/main/src/routes/%2Bpage.svelte): `src/routes/+page.svelte`
- [LLM settings](https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/settings/LlmSettingsSection.svelte): `src/lib/components/settings/LlmSettingsSection.svelte`
- [Settings fields](https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/settings/SettingsField.svelte): `src/lib/components/settings/SettingsField.svelte`
- [Research app](https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/apps/ResearchApp.svelte): `src/lib/components/apps/ResearchApp.svelte`
- [Wallpaper catalog](https://github.com/jhanroenz/vision-os/blob/main/src/lib/wallpapers/catalog.ts): `src/lib/wallpapers/catalog.ts`
- [Wallpaper renderer](https://github.com/jhanroenz/vision-os/blob/main/src/lib/wallpapers/engine.ts): `src/lib/wallpapers/engine.ts`

### Agent services

- [Jarvis agent](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/agent.js): `src/lib/server/agent.js`
- [LLM providers](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/llmProviders.js): `src/lib/server/llmProviders.js`
- [Workspace services](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/workspace.js): `src/lib/server/workspace.js`
- [Web search policy](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/webSearchPolicy.js): `src/lib/server/webSearchPolicy.js`
- [Search engines](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/searxngEngines.js): `src/lib/server/searxngEngines.js`
- [SearXNG runtime](https://github.com/jhanroenz/vision-os/blob/main/searxng/lib.mjs): `searxng/lib.mjs`

### Research

- [Research workflow](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/deepResearch/orchestrator.js): `src/lib/server/deepResearch/orchestrator.js`
- [Query planning](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/deepResearch/queryGenerator.js): `src/lib/server/deepResearch/queryGenerator.js`
- [Research memory](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/deepResearch/sessionMemory.js): `src/lib/server/deepResearch/sessionMemory.js`

### User apps

- [My Apps](https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/apps/UserAppsManagerApp.svelte): `src/lib/components/apps/UserAppsManagerApp.svelte`
- [User app host](https://github.com/jhanroenz/vision-os/blob/main/src/lib/components/apps/UserAppHost.svelte): `src/lib/components/apps/UserAppHost.svelte`
- [App SDK handler](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/userApps/sdkHandler.js): `src/lib/server/userApps/sdkHandler.js`
- [App repository](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/userApps/repository.js): `src/lib/server/userApps/repository.js`
- [App permissions](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/userApps/permissions.js): `src/lib/server/userApps/permissions.js`
- [App jobs](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/userApps/jobRunner.js): `src/lib/server/userApps/jobRunner.js`

### Runtime and state

- [Backend process](https://github.com/jhanroenz/vision-os/blob/main/src-tauri/src/backend.rs): `src-tauri/src/backend.rs`
- [API routes](https://github.com/jhanroenz/vision-os/tree/main/src/routes/api): `src/routes/api`
- [Settings persistence](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/appSettingsDb.js): `src/lib/server/appSettingsDb.js`
- [SQLite database](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/db.js): `src/lib/server/db.js`
- [Runtime config](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/config.js): `src/lib/server/config.js`
- [Path resolution](https://github.com/jhanroenz/vision-os/blob/main/src/lib/server/paths.js): `src/lib/server/paths.js`

### Other components

- **User**

## Connections

- User → Desktop UI: uses (evidence: `README.md`)
- Tauri shell → Backend process: starts (evidence: `src-tauri/src/lib.rs`)
- Backend process → Desktop UI: serves UI (evidence: `README.md`)
- Desktop UI → API routes: requests (evidence: `README.md`)
- LLM settings → Settings fields: renders (evidence: `src/lib/components/settings/LlmSettingsSection.svelte`)
- User → LLM settings: configures (evidence: `README.md`)
- API routes → Jarvis agent: dispatches
- Jarvis agent → LLM providers: uses
- Jarvis agent → Workspace services: uses
- Jarvis agent → Web search policy: uses
- Web search policy → Search engines: reads usage (evidence: `src/lib/server/searxngEngines.js`)
- Search engines → Web search policy: reads policy (evidence: `src/lib/server/searxngEngines.js`)
- User → Research app: requests research (evidence: `README.md`)
- Research app → API routes: requests (evidence: `README.md`)
- API routes → Research workflow: dispatches
- Research workflow → Query planning: plans queries
- Query planning → Research memory: suggests follow-ups (evidence: `src/lib/server/deepResearch/queryGenerator.js`)
- Research workflow → Web search policy: searches web
- User → My Apps: manages apps (evidence: `README.md`)
- My Apps → API routes: requests
- My Apps → User app host: opens apps
- User app host → App SDK handler: calls SDK
- App SDK handler → App repository: reads and writes (evidence: `src/lib/server/userApps/sdkHandler.js`)
- App SDK handler → App permissions: checks access (evidence: `src/lib/server/userApps/sdkHandler.js`)
- App SDK handler → App jobs: runs jobs (evidence: `src/lib/server/userApps/sdkHandler.js`)
- My Apps → Workspace services: builds in (evidence: `README.md`)
- My Apps → API routes: publishes through (evidence: `README.md`)
- LLM settings → API routes: saves settings
- SQLite database → Runtime config: reads configuration (evidence: `src/lib/server/db.js`)
- SQLite database → Settings persistence: migrates settings (evidence: `src/lib/server/db.js`)
- Runtime config → Path resolution: resolves directories (evidence: `src/lib/server/config.js`)
- Wallpaper renderer → Wallpaper catalog: uses catalog (evidence: `src/lib/wallpapers/engine.ts`)
