How ranthonybeckett/tau works
TAU is a local, voice-first computer and home-lab assistant. Its main workflow takes typed or spoken input through the assistant, consults a configured model and local context, then replies on the display and through speech; requests to change things are mediated by permissioned organs. Separate branches cover user-approved project work, machine/service discovery and monitoring, app connections, and searchable knowledge. The excerpts show key capability implementations, but not the runtime’s complete wiring, so uncertain links are omitted or marked unverified.
Main entry points: assistant.py Assistant runtime · server.py Local display · builtin.py Built-in actions · search.py Knowledge search
Components 26
Conversation and display
- Assistant runtime
src/tau/assistant.py - Speech input
src/tau/ears/pipeline.py - Audio I/O
src/tau/audio.py - Local display
src/tau/display/server.py - Display state
src/tau/display/model.py - Model client
src/tau/brainclient.py - Model discovery
src/tau/detect.py
Permissioned capabilities
- Permission gate
src/tau/organs/base.py - Built-in actions
src/tau/organs/builtin.py - System readings
src/tau/senses/gpu.py - Model lanes
src/tau/lanes.py
Project work and connections
- Work jobs
src/tau/work.py - Worker discovery
src/tau/connect/finders/workers.py - App connections
src/tau/appconnect.py - Connection registry
src/tau/connect/registry.py
Lab awareness
- Machine discovery
src/tau/discovery/collect.py - Lab map
src/tau/discovery/labmap.py - Host sensors
src/tau/senses/drives.py
Configuration and knowledge
- Profile settings
src/tau/profile.py - Live settings
src/tau/settings.py - Knowledge search
src/tau/knowledge/search.py - OKF knowledge
src/tau/okf.py - Full-text index
src/tau/knowledge/fts.py - Action receipts
src/tau/actionlog.py - Local paths
src/tau/paths.py
Other components
- User
Connections 33
- User → Local display: types and clicks
src/tau/display/server.py - User → Speech input: speaks
README.md - Speech input → Audio I/O: captures audio
src/tau/ears/pipeline.py - Assistant runtime → Speech input: uses hearing
src/tau/ears/pipeline.py - Local display → Assistant runtime: submits text
- Assistant runtime → Model client: requests reply
- Assistant runtime → Audio I/O: speaks reply
- Assistant runtime → Display state: publishes conversation
- Local display → Display state: serves state
src/tau/display/server.py - Assistant runtime → Permission gate: dispatches actions
- Permission gate → Built-in actions: checks and runs
src/tau/organs/base.py - Built-in actions → System readings: reads system state
src/tau/organs/builtin.py - Built-in actions → Model lanes: switches model
src/tau/organs/builtin.py - Assistant runtime → Work jobs: routes work requests
- Local display → Work jobs: submits jobs
src/tau/display/server.py - Work jobs → Worker discovery: uses discovered workers
- Local display → App connections: connects apps
- Worker discovery → Connection registry: registers finder
src/tau/connect/finders/workers.py - Assistant runtime → Machine discovery: requests lab checks
- Machine discovery → Lab map: updates map
src/tau/discovery/collect.py - Built-in actions → Lab map: answers lab queries
src/tau/organs/builtin.py - Lab map → OKF knowledge: stores lab notes
src/tau/discovery/labmap.py - Built-in actions → Host sensors: reads host state
src/tau/organs/builtin.py - Assistant runtime → Profile settings: loads configuration
- Local display → Live settings: views and changes
src/tau/display/server.py - Assistant runtime → Knowledge search: searches context
- Knowledge search → OKF knowledge: searches folders
src/tau/knowledge/search.py - Knowledge search → Full-text index: searches index
src/tau/knowledge/search.py - Permission gate → Action receipts: records actions
src/tau/organs/base.py - Profile settings → Local paths: resolves profile path
src/tau/profile.py - Knowledge search → Local paths: resolves brain folder
src/tau/knowledge/search.py - Assistant runtime → Model discovery: checks model endpoints
- Model discovery → Model client: finds available models
src/tau/detect.py