How noirwolvex/jarvis- works
JARVIS is a Windows-first desktop AI agent with two distinct control surfaces: the Python agent for real desktop missions and a Next.js control center that defaults to deterministic simulation, with optional hybrid and native-daemon modes. The main mission path accepts a dashboard request, routes it to the Python worker in hybrid mode, and uses agent planning, permissions, tools, and verification to act on the desktop. The graph also preserves simulation and Rust execution as separate paths. Python orchestration and most runtime wiring are based on the README; unsampled implementation details are not inferred.
Main entry points: agent.py Task Agent · tools.py Tool Registry · runtime.ts Simulation Runtime · route.ts Control API
Components 23
Control Center
- Mission Dashboard
apps/control-center/src/components/control-center.tsx - Control API
apps/control-center/src/app/api/control/route.ts - Hybrid Control
apps/control-center/src/lib/hybrid-control.ts - Control Service
apps/control-center/src/lib/control-service.ts
Python Agent
- Mission Worker
core/full_access_worker.py - Agent Bridge
core/full_access_bridge.py - Task Agent
core/agent.py - Task Orchestrator
core/orchestrator.py - Skills
core/skills.py - Permission Engine
core/permissions.py - Tool Registry
core/tools.py - Persistent Memory
core/memory.py
Execution Backends
- Desktop Tools
core/desktop_control_tools.py - Browser Tools
core/browser_tab_tools.py - Chrome CDP
core/chrome_cdp.py - Filesystem Tools
core/filesystem_tools.py - Daemon Client
apps/control-center/src/lib/daemon-client.ts - Rust Execution Daemon
daemon/rust/src/dispatcher.rs
Simulation Runtime
- Simulation Runtime
services/runtime/src/runtime.ts - Mission Scheduler
services/runtime/src/scheduler.ts - Simulation State
services/runtime/src/state.ts - Event Stream
services/runtime/src/events.ts
Other components
- Operator
Connections 23
- Operator → Mission Dashboard: submits mission
- Mission Dashboard → Control API: sends control
- Control API → Hybrid Control: routes hybrid requests
- Control API → Control Service: routes simulation or native
- Hybrid Control → Mission Worker: submits mission
- Mission Worker → Agent Bridge: runs mission
- Agent Bridge → Task Agent: builds agent
- Task Agent → Task Orchestrator: tracks task
- Task Agent → Skills: uses guidance
- Task Agent → Permission Engine: checks actions
- Task Agent → Tool Registry: dispatches tools
- Task Agent → Persistent Memory: reads and writes
- Tool Registry → Desktop Tools: dispatches
- Tool Registry → Browser Tools: dispatches
- Tool Registry → Filesystem Tools: dispatches
- Browser Tools → Chrome CDP: uses session
- Desktop Tools → Daemon Client: uses native engine
- Daemon Client → Rust Execution Daemon: sends TLS actions
- Control Service → Simulation Runtime: creates simulation
- Simulation Runtime → Mission Scheduler: schedules missions
- Simulation Runtime → Simulation State: updates state
- Simulation Runtime → Event Stream: emits events
- Control Service → Daemon Client: requests native actions