How egjjr/speaky works
Speaky is a macOS hold-to-talk voice companion: the user holds Control and Option, speaks while the microphone is active, and receives an action through the notch UI. The documented workflow runs from speech understanding and planning to Mac-native actions, with local confirmation for consequential operations. The graph preserves the documented app, web/link, notes, window-tiling, and search capabilities. Several implementation modules were not sampled, so their internal connections are omitted unless the README or source index supports them.
Main entry points: NotchModel.swift Turn coordinator · Executor.swift Action executor · Planner.swift Request planner · SpeechListener.swift Speech capture
Components 22
Voice interaction
- Hold controls
Sources/ForeApp/HoldToTalk.swift - Speech capture
Sources/ForeApp/SpeechListener.swift - Audio analyzer
Sources/ForeApp/SpeechAnalyzerCapture.swift - Notch interface
Sources/ForeApp/NotchView.swift - Turn coordinator
Sources/ForeApp/NotchModel.swift
Understanding and planning
- Request planner
Sources/ForeCore/Planner.swift - Streaming planner
Sources/ForeCore/StreamingPlanner.swift - Screen-aware routing
Sources/ForeCore/ContextRouter.swift - App catalog
Sources/ForeCore/AppCatalog.swift - Live computer
Sources/ForeCore/LiveComputer.swift
Mac actions
- Action executor
Sources/ForeCore/Executor.swift - App launching
Sources/ForeCore/SpokenApp.swift - Link following
Sources/ForeCore/LinkFollow.swift - Notes task
Sources/ForeCore/NotesTask.swift - Window tiling
Sources/ForeCore/WindowLayout.swift - Search and desk
Sources/ForeCore/Desk.swift - Accessibility actions
Sources/ForeCore/AccessibilityLinkFollower.swift
Context and safeguards
- Front-app context
Sources/ForeCore/SystemFrontContext.swift - Confirmation gate
Sources/ForeCore/ToolGate.swift - Installed apps
Sources/ForeCore/AppCatalog.swift
Other components
- Speaker
- Model services
Connections 23
- Speaker → Hold controls: holds keys
- Hold controls → Speech capture: starts capture
Sources/ForeApp/HoldToTalk.swift - Speech capture → Audio analyzer: captures audio
Sources/ForeApp/SpeechListener.swift - Speech capture → Turn coordinator: provides transcript
Sources/ForeApp/NotchModel.swift - Turn coordinator → Notch interface: updates status
Sources/ForeApp/NotchView.swift - Turn coordinator → Request planner: plans request
Sources/ForeApp/NotchModel.swift - Turn coordinator → Streaming planner: streams decisions
Sources/ForeApp/NotchModel.swift - Request planner → Screen-aware routing: checks screen context
Sources/ForeCore/Planner.swift - Screen-aware routing → Front-app context: uses snapshot
- Request planner → App catalog: resolves app names
Sources/ForeCore/Planner.swift - Turn coordinator → Front-app context: reads front context
Sources/ForeApp/NotchModel.swift - Turn coordinator → Live computer: steps live plan
Sources/ForeApp/NotchModel.swift - Turn coordinator → Action executor: executes plan
Sources/ForeApp/NotchModel.swift - Action executor → App launching: launches apps
Sources/ForeCore/Executor.swift - Action executor → Link following: follows links
- Action executor → Notes task: writes notes
- Action executor → Window tiling: tiles windows
Sources/ForeCore/Executor.swift - Turn coordinator → Search and desk: runs desk tasks
Sources/ForeApp/NotchModel.swift - Action executor → Accessibility actions: uses accessibility
Sources/ForeCore/Executor.swift - Turn coordinator → Confirmation gate: checks action risk
Sources/ForeApp/NotchModel.swift - Installed apps → App catalog: provides installed apps
Sources/ForeCore/AppCatalog.swift - Model services → Request planner: fills planning gaps
- Speaker → Notch interface: confirms locally