How gouwsxander/apple-intelligence-api works
This is a Vapor HTTP wrapper for Apple’s on-device Foundation Models, exposing an OpenAI-compatible API. A client posts a prompt or conversation; routing decodes the request, constructs a model session, selects ordinary or streaming response generation, and returns completion data or SSE chunks. The documented surface also includes model listing and structured JSON-schema outputs. Setup and inference wiring are shown in the excerpts; the streaming and structured-output branches are implemented in the sampled session and response-generator modules. No database-backed product behavior is evident despite database configuration.
Main entry points: routes.swift API routes · ResponseSession.swift Inference session · RequestContent.swift Request schema · entrypoint.swift Server entrypoint
Components 10
HTTP API
- Server entrypoint
Sources/AppleIntelligenceApi/entrypoint.swift - App configuration
Sources/AppleIntelligenceApi/configure.swift - API routes
Sources/AppleIntelligenceApi/routes.swift
Request and response types
- Request schema
Sources/AppleIntelligenceApi/Utils/RequestContent.swift - Model listing types
Sources/AppleIntelligenceApi/Utils/Models.swift - API errors
Sources/AppleIntelligenceApi/Utils/AbortErrors.swift
Model inference
- Inference session
Sources/AppleIntelligenceApi/Utils/ResponseSession.swift - Foundation Models
Response formatting
- Response selection
Sources/AppleIntelligenceApi/Utils/ResponseGenerator.swift
Other components
- API client
Connections 12
- API client → Server entrypoint: sends requests
README.md - Server entrypoint → App configuration: configures app
Sources/AppleIntelligenceApi/entrypoint.swift - App configuration → API routes: registers routes
Sources/AppleIntelligenceApi/configure.swift - API client → API routes: calls API
README.md - API routes → Request schema: decodes body
Sources/AppleIntelligenceApi/routes.swift - API routes → Inference session: creates session
Sources/AppleIntelligenceApi/routes.swift - Inference session → Request schema: reads options
Sources/AppleIntelligenceApi/Utils/ResponseSession.swift - Inference session → Foundation Models: runs generation
Sources/AppleIntelligenceApi/Utils/ResponseSession.swift - API routes → Response selection: selects formatter
Sources/AppleIntelligenceApi/routes.swift - Response selection → Inference session: gets response
Sources/AppleIntelligenceApi/Utils/ResponseGenerator.swift - API routes → Model listing types: returns model list
Sources/AppleIntelligenceApi/routes.swift - Request schema → Inference session: defines structured output
Sources/AppleIntelligenceApi/Utils/RequestContent.swift