How openai/openai-live-console works
OpenAI Live Console is a local voice interface for discussing a fictional backpack catalog. The user starts a microphone-enabled conversation; the browser establishes Live audio and displays events, while the local server manages credentials, session lifecycle, and read-only catalog tools. Delegation can be Live-managed or app-managed, with the latter calling a Responses backend. The README documents these capabilities; edges involving unsampled request paths rely on that documentation rather than inspected implementations.
Main entry points: http.ts HTTP Gateway · session.ts Live Session · App.tsx Console UI · index.ts Server Startup
Components 14
Browser Console
- Console UI
client/App.tsx - Browser Session
client/session.ts - Event State
client/state.ts
Local Server
- Server Startup
server/index.ts - Runtime Config
server/config.ts - HTTP Gateway
server/http.ts - Live Session
server/session.ts - Error Mapping
server/errors.ts
Tools And Protocol
- Shared Events
shared/types.ts - Event Protocol
server/protocol.ts - Catalog Tools
server/catalog.ts
OpenAI Services
- OpenAI Adapter
server/openai.ts
Other components
- Console User
- OpenAI APIs
Connections 18
- Console User → Console UI: uses
README.md - Console UI → Browser Session: starts session
client/App.tsx - Console UI → Event State: reduces events
client/App.tsx - Console UI → HTTP Gateway: fetches config
client/App.tsx - Browser Session → HTTP Gateway: creates and closes
README.md - Browser Session → OpenAI APIs: streams WebRTC audio
README.md - Server Startup → Runtime Config: loads settings
server/index.ts - Server Startup → OpenAI Adapter: creates adapter
server/index.ts - Server Startup → HTTP Gateway: creates app
server/index.ts - HTTP Gateway → Live Session: routes sessions
server/http.ts - HTTP Gateway → Error Mapping: maps failures
server/http.ts - Live Session → OpenAI Adapter: creates and attaches
server/session.ts - Live Session → Catalog Tools: executes tools
server/session.ts - Live Session → Event Protocol: records events
server/session.ts - Live Session → OpenAI APIs: delegates backend work
README.md - OpenAI Adapter → OpenAI APIs: calls Live and Responses
server/openai.ts - Event Protocol → Catalog Tools: uses tool definitions
server/protocol.ts - HTTP Gateway → Runtime Config: checks settings
server/http.ts