How jhanroenz/vision-os works
VisionOS is a desktop AI environment combining a SvelteKit interface, Jarvis backend, and Tauri shell. The main workflow is a user interacting with desktop apps, sending work through API routes to backend capabilities, and receiving results; persistent settings, conversations, and workspace data support that work. Research and user-app creation are distinct product branches, with user apps published into My Apps. Edges use README architecture statements and indexed source references; unsampled implementation details are omitted or marked unverified rather than inferred.
Main entry points: api API routes · UserAppsManagerApp.svelte My Apps · agent.js Jarvis agent · sdkHandler.js App SDK handler
Components 29
Desktop experience
- Tauri shell
src-tauri/src/lib.rs - Desktop UI
src/routes/+page.svelte - LLM settings
src/lib/components/settings/LlmSettingsSection.svelte - Settings fields
src/lib/components/settings/SettingsField.svelte - Research app
src/lib/components/apps/ResearchApp.svelte - Wallpaper catalog
src/lib/wallpapers/catalog.ts - Wallpaper renderer
src/lib/wallpapers/engine.ts
Agent services
- Jarvis agent
src/lib/server/agent.js - LLM providers
src/lib/server/llmProviders.js - Workspace services
src/lib/server/workspace.js - Web search policy
src/lib/server/webSearchPolicy.js - Search engines
src/lib/server/searxngEngines.js - SearXNG runtime
searxng/lib.mjs
Research
- Research workflow
src/lib/server/deepResearch/orchestrator.js - Query planning
src/lib/server/deepResearch/queryGenerator.js - Research memory
src/lib/server/deepResearch/sessionMemory.js
User apps
- My Apps
src/lib/components/apps/UserAppsManagerApp.svelte - User app host
src/lib/components/apps/UserAppHost.svelte - App SDK handler
src/lib/server/userApps/sdkHandler.js - App repository
src/lib/server/userApps/repository.js - App permissions
src/lib/server/userApps/permissions.js - App jobs
src/lib/server/userApps/jobRunner.js
Runtime and state
- Backend process
src-tauri/src/backend.rs - API routes
src/routes/api - Settings persistence
src/lib/server/appSettingsDb.js - SQLite database
src/lib/server/db.js - Runtime config
src/lib/server/config.js - Path resolution
src/lib/server/paths.js
Other components
- User
Connections 32
- User → Desktop UI: uses
README.md - Tauri shell → Backend process: starts
src-tauri/src/lib.rs - Backend process → Desktop UI: serves UI
README.md - Desktop UI → API routes: requests
README.md - LLM settings → Settings fields: renders
src/lib/components/settings/LlmSettingsSection.svelte - User → LLM settings: configures
README.md - API routes → Jarvis agent: dispatches
- Jarvis agent → LLM providers: uses
- Jarvis agent → Workspace services: uses
- Jarvis agent → Web search policy: uses
- Web search policy → Search engines: reads usage
src/lib/server/searxngEngines.js - Search engines → Web search policy: reads policy
src/lib/server/searxngEngines.js - User → Research app: requests research
README.md - Research app → API routes: requests
README.md - API routes → Research workflow: dispatches
- Research workflow → Query planning: plans queries
- Query planning → Research memory: suggests follow-ups
src/lib/server/deepResearch/queryGenerator.js - Research workflow → Web search policy: searches web
- User → My Apps: manages apps
README.md - My Apps → API routes: requests
- My Apps → User app host: opens apps
- User app host → App SDK handler: calls SDK
- App SDK handler → App repository: reads and writes
src/lib/server/userApps/sdkHandler.js - App SDK handler → App permissions: checks access
src/lib/server/userApps/sdkHandler.js - App SDK handler → App jobs: runs jobs
src/lib/server/userApps/sdkHandler.js - My Apps → Workspace services: builds in
README.md - My Apps → API routes: publishes through
README.md - LLM settings → API routes: saves settings
- SQLite database → Runtime config: reads configuration
src/lib/server/db.js - SQLite database → Settings persistence: migrates settings
src/lib/server/db.js - Runtime config → Path resolution: resolves directories
src/lib/server/config.js - Wallpaper renderer → Wallpaper catalog: uses catalog
src/lib/wallpapers/engine.ts