How lalalic/neox works
Neox is an iPhone media MCP server for desktop coding agents, with a companion Mac gateway called NeoY. The main workflow is: an agent connects to the phone over the LAN, searches or analyzes its photo library, then exports media for download. Separate user-facing paths support Siri handoff, guided Capture Tours, and asynchronous Vlog submissions. NeoY provides the Mac-side authenticated gateway and native capabilities, and federates a bundled MCP runtime. Several Mac-side links are documented capabilities; unsampled wiring is not inferred.
Main entry points: MCPServer.swift NeoY MCP gateway · ServerController.swift Server lifecycle · RunAgentIntent.swift Run Agent intent · AppAgentToolProvider.swift UI pilot tools
Components 26
iPhone MCP service
- Phone MCP server
Neox/Server/MCPServer.swift - Server lifecycle
Neox/Server/ServerController.swift - Status screen
Neox/App/StatusScreen.swift
Media and capture
- Media tools
Neox/Server/MediaTools.swift - Vision tools
Neox/Server/VisionTools.swift - Persistent vision index
Neox/Server/VisionIndex.swift - Capture Tour
Neox/Server/CaptureTour.swift - Tour runner UI
Neox/App/CaptureTourView.swift - Vlog submission
Neox/App/VlogSubmission.swift
Agent interaction
- Run Agent intent
Neox/Intents/RunAgentIntent.swift - Handoff message
Neox/Intents/AgentHandoff.swift - Bridge discovery
Neox/Intents/AgentBridge.swift - UI pilot tools
Neox/AgentKit/AppAgentToolProvider.swift - Accessibility scanner
Neox/AgentKit/AccessibilityScanner.swift - Interaction engine
Neox/AgentKit/InteractionEngine.swift - Demo tools
Neox/AgentKit/DemoToolProvider.swift
NeoY Mac host
- NeoY capability host
mac/NeoY/Sources/NeoY/NeoYApp.swift - NeoY MCP gateway
mac/NeoY/Sources/NeoY/MCPServer.swift - Phone client
mac/NeoY/Sources/NeoY/NeoXPhoneClient.swift - Phone tools
mac/NeoY/Sources/NeoY/NeoXPhoneTools.swift - MCP federation
mac/NeoY/Sources/NeoY/MCPFederation.swift
Bundled runtime
- Bundled MCP runtime
mac/NeoY/Runtime/src/core/mcp-gateway.mjs - ChatGPT adapter
mac/NeoY/Runtime/src/xchat/chatgpt-responses-adapter.mjs - Chat lifecycle
mac/NeoY/Runtime/src/xchat/lifecycle.mjs
Other components
- Desktop agent
- iCloud Drive folder
Connections 26
- Desktop agent → Phone MCP server: calls tools
README.md - Server lifecycle → Phone MCP server: starts server
Neox/Server/ServerController.swift - Server lifecycle → Media tools: registers tools
Neox/Server/ServerController.swift - Server lifecycle → Vision tools: registers tools
Neox/Server/ServerController.swift - Media tools → Persistent vision index: reads analysis
Neox/Server/MediaTools.swift - Desktop agent → Vision tools: requests analysis
README.md - Desktop agent → Capture Tour: starts tour
README.md - Capture Tour → Media tools: uses file cache
Neox/Server/CaptureTour.swift - Status screen → Tour runner UI: opens runner
Neox/App/StatusScreen.swift - Status screen → Vlog submission: opens submission
Neox/App/StatusScreen.swift - Vlog submission → iCloud Drive folder: writes submission
README.md - iCloud Drive folder → Desktop agent: signals ready
README.md - Run Agent intent → Server lifecycle: starts server
Neox/Intents/RunAgentIntent.swift - Run Agent intent → Handoff message: composes message
Neox/Intents/RunAgentIntent.swift - Run Agent intent → Bridge discovery: posts handoff
Neox/Intents/RunAgentIntent.swift - UI pilot tools → Accessibility scanner: scans interface
Neox/AgentKit/AppAgentToolProvider.swift - UI pilot tools → Interaction engine: dispatches actions
Neox/AgentKit/AppAgentToolProvider.swift - UI pilot tools → Demo tools: provides demo commands
Neox/AgentKit/AppAgentToolProvider.swift - NeoY capability host → NeoY MCP gateway: hosts gateway
- NeoY MCP gateway → Bundled MCP runtime: federates runtime
README.md - NeoY MCP gateway → Phone tools: exposes phone tools
- Phone tools → Phone client: uses transport
- Phone client → Phone MCP server: connects over HTTP
README.md - NeoY MCP gateway → ChatGPT adapter: uses adapter
- NeoY MCP gateway → Chat lifecycle: uses lifecycle
- NeoY MCP gateway → MCP federation: federates services