How rbrown101010/bluey-by-riley works
Googly Eyes is a paired iPhone and Mac assistant: the user wakes it and holds the phone to ask; the phone streams microphone audio to OpenAI Realtime, while the Mac supplies short-lived credentials and executes screen, cursor, and computer-control tools. Replies appear as Mac cursor bubbles, with a phone chirp and saved transcript. The graph also preserves web research, pairing, settings, and session history. Edges follow README-documented behavior or source-index references; several unsampled implementations are represented only at their known paths.
Main entry points: RealtimeHost.swift Tool host · GooglyApp.swift App shell · AppDelegate.swift Menu bar app · BlueyAppView.swift Character and controls
Components 25
iPhone experience
- App shell
iOS/Sources/GooglyApp.swift - Character and controls
iOS/Sources/BlueyAppView.swift - Character face
iOS/Sources/FaceView.swift - Voice session
iOS/Sources/LiveVoice.swift - Mac pairing
iOS/Sources/MacLink.swift - Pairing controls
iOS/Sources/PairingView.swift - Session history
iOS/Sources/SessionStore.swift - Chirp controls
iOS/Sources/SoundButton.swift
Mac assistant
- Menu bar app
Mac/Sources/GooglyMac/AppDelegate.swift - Phone server
Mac/Sources/GooglyMac/PhoneServer.swift - Tool host
Mac/Sources/GooglyMac/RealtimeHost.swift - Cursor and bubbles
Mac/Sources/GooglyMac/CursorOverlay.swift - Preferences
Mac/Sources/GooglyMac/Settings.swift - API key storage
Mac/Sources/GooglyMac/Keychain.swift
Mac capabilities
- Screen understanding
Mac/Sources/GooglyMac/ScreenReader.swift - Accessible controls
Mac/Sources/GooglyMac/ControlsReader.swift - Computer actions
Mac/Sources/GooglyMac/ComputerControl.swift - Web research
Mac/Sources/GooglyMac/WebResearch.swift - Research reports
Mac/Sources/GooglyMac/ReportPanel.swift
Shared protocol and design
- Pairing protocol
Shared/GooglyLink.swift - Color palette
Shared/Palette.swift
Other components
- User
- OpenAI Realtime
- OpenAI Responses
- Web search
Connections 36
- User → App shell: uses
README.md - App shell → Character and controls: presents
iOS/Sources/GooglyApp.swift - App shell → Character face: shows
iOS/Sources/GooglyApp.swift - Character and controls → Voice session: starts and asks
iOS/Sources/BlueyAppView.swift - Character and controls → Session history: shows sessions
iOS/Sources/BlueyAppView.swift - Character and controls → Mac pairing: uses
iOS/Sources/BlueyAppView.swift - App shell → Pairing controls: presents
iOS/Sources/GooglyApp.swift - App shell → Session history: uses
iOS/Sources/GooglyApp.swift - App shell → Chirp controls: presents
iOS/Sources/GooglyApp.swift - Pairing controls → Mac pairing: selects Mac
iOS/Sources/PairingView.swift - Voice session → OpenAI Realtime: streams audio
README.md - Voice session → Mac pairing: requests token and tools
iOS/Sources/LiveVoice.swift - Voice session → Session history: records turns
- Mac pairing → Phone server: connects over Bonjour
README.md - Phone server → Pairing protocol: exchanges packets
README.md - Menu bar app → Phone server: starts server
Mac/Sources/GooglyMac/AppDelegate.swift - Menu bar app → Tool host: controls sessions
Mac/Sources/GooglyMac/AppDelegate.swift - Menu bar app → Cursor and bubbles: controls cursor
Mac/Sources/GooglyMac/AppDelegate.swift - Menu bar app → Preferences: updates preferences
Mac/Sources/GooglyMac/AppDelegate.swift - Tool host → Phone server: mints phone token
README.md - Tool host → OpenAI Realtime: creates client secret
README.md - Tool host → Screen understanding: runs screen tools
Mac/Sources/GooglyMac/RealtimeHost.swift - Tool host → Computer actions: runs action tools
Mac/Sources/GooglyMac/RealtimeHost.swift - Tool host → Accessible controls: uses controls
Mac/Sources/GooglyMac/RealtimeHost.swift - Tool host → Cursor and bubbles: shows replies and pointing
README.md - Tool host → Web research: invokes research
Mac/Sources/GooglyMac/RealtimeHost.swift - Tool host → Research reports: presents reports
Mac/Sources/GooglyMac/RealtimeHost.swift - Tool host → API key storage: reads API key
Mac/Sources/GooglyMac/RealtimeHost.swift - Web research → OpenAI Responses: submits research
Mac/Sources/GooglyMac/WebResearch.swift - OpenAI Responses → Web search: searches
- Menu bar app → API key storage: saves API key
Mac/Sources/GooglyMac/AppDelegate.swift - Screen understanding → Accessible controls: reads controls
Mac/Sources/GooglyMac/ScreenReader.swift - Cursor and bubbles → Preferences: reads display options
Mac/Sources/GooglyMac/CursorOverlay.swift - Character and controls → Color palette: uses colors
iOS/Sources/BlueyAppView.swift - Character face → Color palette: uses colors
iOS/Sources/FaceView.swift - Cursor and bubbles → Color palette: uses colors
Mac/Sources/GooglyMac/CursorOverlay.swift