How khaled-dragon/waey works
Waey is a screen-aware desktop AI assistant. A user opens its overlay, captures a screen region or uses fresh readable desktop context, then submits a prompt; the app streams a model response and can save the conversation locally. Separate workflows support stepwise Guide Mode, approval-gated desktop actions, and optional workspace-aware developer help. The graph combines sampled call sites with README-documented capabilities; several feature implementations are listed in the tree but were not sampled, so their specific internal calls are not asserted.
Main entry points: App.tsx Overlay UI · llm.rs Model streaming · dev_context.rs Developer context · storage.rs SQLite storage
Components 25
Desktop interaction
- Overlay UI
src/App.tsx - Chat composer
src/components/ChatComposer.tsx - Response panel
src/components/ResponsePanel.tsx
Assistant workflows
- Chat workflow
src/features/chat/useLlmChat.ts - Model streaming
src-tauri/src/llm.rs - Guide session
src/features/guide/useGuideSession.ts - Guide service
src-tauri/src/guide.rs - Action mode
src-tauri/src/screen_intelligence/action.rs
Screen and workspace context
- Screen capture
src-tauri/src/capture.rs - Capture events
src/features/capture/useScreenCaptureEvents.ts - UI context
src-tauri/src/ui_context.rs - Context cache
src-tauri/src/screen_intelligence/context_cache.rs - UI automation
src-tauri/src/screen_intelligence/windows_uia.rs - Native UIA
src-tauri/src/screen_intelligence/windows_native_uia.rs - Developer context
src-tauri/src/dev_context.rs - Workspace access
src-tauri/src/workspace.rs - Spreadsheet support
src-tauri/src/spreadsheet.rs
Desktop services
- App updates
src/features/updates/useAppUpdates.ts
Configuration and history
- Provider service
src-tauri/src/providers.rs - App settings
src-tauri/src/settings.rs - Personas
src-tauri/src/personas.rs - Conversation history
src-tauri/src/history.rs - SQLite storage
src-tauri/src/storage.rs
Other components
- User
- Model provider
Connections 32
- User → Overlay UI: opens and prompts
- Overlay UI → Chat composer: presents
src/App.tsx - Overlay UI → Screen capture: requests capture
src/App.tsx - Screen capture → Capture events: emits capture events
- Capture events → Overlay UI: provides capture state
src/features/capture/useScreenCaptureEvents.ts - Overlay UI → UI context: requests fresh context
src/App.tsx - UI context → Context cache: captures or reuses
- Context cache → UI automation: collects UI structure
- UI automation → Native UIA: uses native collection
- Chat composer → Chat workflow: submits prompt
- Chat workflow → Model streaming: sends prompt
src/features/chat/useLlmChat.ts - Model streaming → Model provider: streams completion
src-tauri/src/llm.rs - Provider service → Model provider: configures endpoint
- Model streaming → UI context: uses screen facts
src-tauri/src/llm.rs - Model streaming → Developer context: uses developer access settings
src-tauri/src/llm.rs - Chat workflow → Response panel: streams updates
src/features/chat/useLlmChat.ts - Response panel → Guide session: handles guide responses
src/components/ResponsePanel.tsx - Guide session → Guide service: requests guide steps
- Guide session → Overlay UI: shows guide UI
src/App.tsx - Overlay UI → Action mode: applies approved action
src/App.tsx - Action mode → Native UIA: verifies and acts
- Overlay UI → Developer context: builds context
src/App.tsx - Developer context → Workspace access: checks workspace access
src-tauri/src/dev_context.rs - Developer context → Spreadsheet support: handles spreadsheet context
src-tauri/src/dev_context.rs - App settings → SQLite storage: reads and writes settings
src-tauri/src/settings.rs - Provider service → SQLite storage: uses persistent storage
src-tauri/src/providers.rs - Conversation history → SQLite storage: persists chats
- Personas → SQLite storage: persists personas
- Overlay UI → Conversation history: browses saved chats
- Overlay UI → Personas: selects personas
- Overlay UI → App settings: edits preferences
- Overlay UI → App updates: checks for updates