How sokmeankao/luma works
Luma captures browser-tab playback, obtains an ephemeral live-session credential, streams audio for Gemini Live Translate, and presents original and translated text; voice playback is optional. The web workspace owns the live-session orchestration, while a Go loopback API serves capabilities and mints credentials. Electron reuses that workspace and adds source selection, process-loopback support, and floating subtitles. The README documents a translation-provider package, but that package is absent from the supplied tree; provider internals are therefore represented as an external service. Connections reflect excerpts or explicit README statements.
Main entry points: LiveWorkspace.tsx Live workspace · handlers.go API handlers · App.tsx Desktop live app · ipc.ts Desktop IPC contract
Components 24
Live web experience
- Home mode
apps/web/src/app/page.tsx - Live workspace
apps/web/src/components/LiveWorkspace.tsx - Language selection
apps/web/src/components/LanguagePairControls.tsx - Language catalog
apps/web/src/lib/language-catalog.ts - Capture controls
apps/web/src/components/CapturePanel.tsx - Shared transcript UI
packages/ui/src/index.tsx - Transcript preview
apps/web/src/app/preview/transcript/page.tsx - API client
apps/web/src/lib/api.ts
Audio capture and playback
- Browser capture
packages/audio/src/browser-capture.ts - PCM encoding
packages/audio/src/encoder.ts - PCM format tools
packages/audio/src/pcm-mime.ts - Translated audio player
packages/audio/src/translated-audio-player.ts
Local API
- API server
services/api/cmd/server/main.go - API handlers
services/api/internal/httpapi/handlers.go - Language catalog
services/api/internal/languages/catalog.go
Desktop companion
- Desktop live app
apps/desktop/src/renderer/src/App.tsx - Electron main process
apps/desktop/src/main/index.ts - Desktop preload bridge
apps/desktop/src/preload/index.ts - Source picker
apps/desktop/src/main/pick-source.ts - Windows audio host
apps/desktop/src/main/win-audio-host.ts - Desktop IPC contract
apps/desktop/src/shared/ipc.ts - Windows audio module
packages/win-audio/index.js
Other components
- User
- Gemini Live Translate
Connections 25
- User → Home mode: opens app
README.md - Home mode → Live workspace: shows live mode
apps/web/src/app/page.tsx - Live workspace → Language selection: renders controls
apps/web/src/components/LiveWorkspace.tsx - Language selection → Language catalog: derives language pairs
apps/web/src/components/LanguagePairControls.tsx - Live workspace → Capture controls: renders controls
- Live workspace → Browser capture: starts capture
apps/web/src/components/LiveWorkspace.tsx - Live workspace → PCM encoding: uses audio tools
apps/web/src/components/LiveWorkspace.tsx - Live workspace → API client: requests capabilities and token
apps/web/src/components/LiveWorkspace.tsx - API client → API server: HTTP requests
apps/web/src/lib/api.ts - API server → API handlers: creates server
services/api/cmd/server/main.go - API handlers → Language catalog: validates language pairs
services/api/internal/httpapi/handlers.go - API handlers → Gemini Live Translate: mints temporary credential
services/api/internal/httpapi/handlers.go - Live workspace → Gemini Live Translate: streams live session
README.md - Live workspace → Shared transcript UI: presents transcript
README.md - Transcript preview → Shared transcript UI: renders preview
apps/web/src/app/preview/transcript/page.tsx - Live workspace → Translated audio player: plays translated voice
- Translated audio player → PCM format tools: measures PCM duration
packages/audio/src/translated-audio-player.ts - User → Desktop live app: uses desktop app
README.md - Desktop live app → Live workspace: hosts live workspace
apps/desktop/src/renderer/src/App.tsx - Desktop live app → Desktop IPC contract: publishes transcript
apps/desktop/src/renderer/src/App.tsx - Electron main process → Desktop IPC contract: registers IPC
apps/desktop/src/main/index.ts - Electron main process → Windows audio host: starts audio host
apps/desktop/src/main/index.ts - Windows audio host → Source picker: uses process source selection
apps/desktop/src/main/win-audio-host.ts - Source picker → Windows audio module: uses native audio module
apps/desktop/src/main/pick-source.ts - Desktop preload bridge → Desktop IPC contract: exposes IPC API
apps/desktop/src/preload/index.ts