How aipubg/zero works
ZERO is a local-first assistant platform: users submit requests through its control UI, the host handles requests, and agent/inference components can use models and tools to perform work and return outcomes. The repository also includes distinct voice, screen-observation, memory, automation, skill/plugin, and research capabilities. The README describes the intended orchestration broadly, but many runtime connections are unsampled; only explicit imports, calls, or documented relationships are drawn, with unverified integration left out.
Main entry points: index.mjs Agent runtime · runtime-core.mjs Control UI · inference.mjs Agent inference · request-orchestrator.mjs Host request handling
Components 19
User interaction
- Control UI
app/zero-control-ui/runtime-core.mjs - Host request handling
services/host/request-orchestrator.mjs - Sessions
packages/sessions/index.mjs - Voice engine
packages/voice-engine/index.mjs
Assistant execution
- Agent runtime
packages/agent-runtime/index.mjs - Agent inference
packages/agent-runtime/inference.mjs - Model fabric
packages/model-fabric/index.mjs
Task capabilities
- Capability engine
packages/capability-engine/computer-operator.mjs - Computer tools
app/zero-control-ui/src/computer/tools.js - Research and files
packages/research-engine/search.mjs
Context and observation
- Screen intelligence
packages/screen-intelligence/index.mjs - UI observation engine
app/zero-control-ui/observation/engine.mjs - Observation store
app/zero-control-ui/observation/memory-store.mjs - Unified memory
packages/memory/unified-memory.mjs
Background and extensions
- Event automation
packages/automation/event-automation.mjs - Skill execution
packages/skill-sdk/execution.mjs - Plugin SDK
packages/plugin-sdk/index.mjs - Workspaces
packages/workspaces/index.mjs
Other components
- User
Connections 19
- User → Control UI: submits requests
- Control UI → Host request handling: sends requests
- Host request handling → Agent runtime: orchestrates work
- Agent runtime → Agent inference: delegates inference
packages/agent-runtime/index.mjs - Agent inference → Capability engine: executes capabilities
packages/agent-runtime/inference.mjs - Agent inference → Research and files: searches or reads files
packages/agent-runtime/inference.mjs - Agent inference → Model fabric: requests model responses
- Control UI → UI observation engine: configures observation
app/zero-control-ui/runtime-core.mjs - UI observation engine → Observation store: records observations
app/zero-control-ui/observation/engine.mjs - Control UI → Computer tools: exposes computer tools
app/zero-control-ui/runtime-core.mjs - Computer tools → Capability engine: delegates actions
app/zero-control-ui/src/computer/tools.js - Agent runtime → Sessions: uses session context
- Agent runtime → Unified memory: uses persistent memory
- Control UI → Voice engine: accepts voice input
- Agent runtime → Event automation: supports background work
- Agent runtime → Skill execution: runs skills
- Agent runtime → Plugin SDK: uses plugins
- Agent runtime → Workspaces: delegates workspace tasks
- Screen intelligence → Unified memory: persists observations