# xinity-ai/xinity-ai architecture

> Architecture diagram of the GitHub repository xinity-ai/xinity-ai, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-09-27). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/xinity-ai/xinity-ai
- Repository: https://github.com/xinity-ai/xinity-ai

## Overview

Xinity is a self-hosted enterprise AI operations platform: users manage organizations, access, deployments, and recorded usage in the dashboard; API clients send OpenAI-compatible inference requests through the gateway to models running on daemon-managed nodes. The README documents the gateway-to-daemon tether and Ollama/vLLM engines. The tree and sampled code also support API/MCP, usage data, and model-catalog services. Some subsystem links reflect documented capabilities rather than inspected implementation; uncertain internal wiring is omitted.

Main entry points: [`packages/xinity-ai-dashboard/src/routes/(authenticated)/+page.server.ts`](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/routes/(authenticated)/%2Bpage.server.ts) (Management dashboard), [`packages/xinity-ai-daemon/src/index.ts`](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/index.ts) (Node daemon), [`packages/xinity-ai-daemon/src/modules/serverfront/openai.ts`](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/modules/serverfront/openai.ts) (OpenAI gateway), [`packages/xinity-ai-dashboard/src/lib/server/orpc/router.ts`](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/orpc/router.ts) (Management API)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_control["Control plane"]
  node_dashboard["Management dashboard<br/>[+page.server.ts]"]
  node_auth["Authentication and SSO<br/>[auth-server.ts]"]
  node_orpc["Management API<br/>[router.ts]"]
  node_mcp["MCP endpoint<br/>[+server.ts]"]
  node_deployment["Deployment orchestration"]
  node_compute["Compute management<br/>[compute.ts]"]
end

subgraph group_inference["Inference plane"]
  node_gateway["OpenAI gateway<br/>[openai.ts]"]
  node_proxy["Gateway proxy<br/>[gateway-proxy.ts]"]
  node_daemon["Node daemon<br/>[index.ts]"]
  node_tether["Tether bridge<br/>[tether-client.ts]"]
  node_model_install["Model installation<br/>[ollama.ts]"]
  node_model_registry["Model registry<br/>[model-registry.ts]"]
end

subgraph group_state["Platform state"]
  node_db[("PostgreSQL<br/>[connection.ts]")]
  node_usage[("Usage and call data<br/>[call-data.ts]")]
  node_audit["Audit and governance<br/>[audit-sink.ts]"]
  node_metrics["Metrics and observability<br/>[metrics.ts]"]
end

subgraph group_integrations["External interfaces"]
  node_cli["Operations CLI<br/>[routes.ts]"]
  node_api_docs["OpenAPI description<br/>[+server.ts]"]
end

subgraph group_catalog["Model information"]
  node_infoserver["Model catalog service<br/>[server.ts]"]
end

node_operator(("Operator"))
node_api_client(("API client"))
node_engines["Inference engines"]

node_operator -->|"manages"| node_dashboard
node_api_client -->|"requests inference"| node_gateway
node_dashboard -->|"authenticates"| node_auth
node_dashboard -->|"calls management API"| node_orpc
node_mcp -->|"dispatches tools"| node_orpc
node_dashboard -->|"reads and writes"| node_db
node_dashboard -->|"queries and rolls up"| node_usage
node_dashboard -->|"manages deployments"| node_deployment
node_deployment -->|"persists configuration"| node_db
node_dashboard -->|"forwards inference"| node_proxy
node_proxy -->|"proxies requests"| node_gateway
node_gateway -->|"routes to nodes"| node_tether
node_tether -->|"bridges node traffic"| node_daemon
node_daemon -->|"manages models"| node_model_install
node_daemon -->|"runs inference"| node_engines
node_daemon -->|"tracks models"| node_model_registry
node_dashboard -->|"manages capacity"| node_compute
node_dashboard -->|"records governance events"| node_audit
node_dashboard -->|"exposes observability"| node_metrics
node_api_client -.->|"calls tools"| node_mcp
node_api_client -.->|"resolves model metadata"| node_infoserver
node_infoserver -.->|"serves model catalogs"| node_model_registry
node_operator -.->|"operates platform"| node_cli
node_cli -.->|"discovers routes"| node_orpc
node_operator -.->|"browses API schema"| node_api_docs

click node_dashboard "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/routes/(authenticated)/%2Bpage.server.ts"
click node_auth "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/auth-server.ts"
click node_orpc "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/orpc/router.ts"
click node_mcp "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/routes/mcp/%2Bserver.ts"
click node_deployment "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/lib/orchestration.mod.ts"
click node_gateway "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/modules/serverfront/openai.ts"
click node_proxy "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/gateway-proxy.ts"
click node_daemon "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/index.ts"
click node_tether "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/modules/tether-client.ts"
click node_model_install "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/modules/model-installation/ollama.ts"
click node_compute "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/compute/compute.ts"
click node_db "https://github.com/xinity-ai/xinity-ai/blob/main/packages/common-db/src/connection.ts"
click node_usage "https://github.com/xinity-ai/xinity-ai/blob/main/packages/common-db/src/schema/call-data.ts"
click node_audit "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/audit/audit-sink.ts"
click node_metrics "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/metrics.ts"
click node_model_registry "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/modules/model-registry.ts"
click node_infoserver "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-infoserver/server.ts"
click node_cli "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-cli/src/lib/act/routes.ts"
click node_api_docs "https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/routes/api/openapi.json/%2Bserver.ts"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_dashboard,node_auth,node_orpc,node_mcp,node_deployment,node_compute,node_api_client toneBlue
class node_gateway,node_proxy,node_daemon,node_tether,node_model_install,node_model_registry toneAmber
class node_db,node_usage,node_audit,node_metrics toneMint
class node_cli,node_api_docs toneRose
class node_infoserver,node_operator,node_engines toneIndigo
```

## Components

### Control plane

- [Management dashboard](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/routes/(authenticated)/%2Bpage.server.ts): `packages/xinity-ai-dashboard/src/routes/(authenticated)/+page.server.ts`
- [Authentication and SSO](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/auth-server.ts): `packages/xinity-ai-dashboard/src/lib/server/auth-server.ts`
- [Management API](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/orpc/router.ts): `packages/xinity-ai-dashboard/src/lib/server/orpc/router.ts`
- [MCP endpoint](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/routes/mcp/%2Bserver.ts): `packages/xinity-ai-dashboard/src/routes/mcp/+server.ts`
- [Deployment orchestration](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/lib/orchestration.mod.ts): `packages/xinity-ai-dashboard/src/lib/server/lib/orchestration.mod.ts`
- [Compute management](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/compute/compute.ts): `packages/xinity-ai-dashboard/src/lib/server/compute/compute.ts`

### Inference plane

- [OpenAI gateway](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/modules/serverfront/openai.ts): `packages/xinity-ai-daemon/src/modules/serverfront/openai.ts`
- [Gateway proxy](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/gateway-proxy.ts): `packages/xinity-ai-dashboard/src/lib/server/gateway-proxy.ts`
- [Node daemon](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/index.ts): `packages/xinity-ai-daemon/src/index.ts`
- [Tether bridge](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/modules/tether-client.ts): `packages/xinity-ai-daemon/src/modules/tether-client.ts`
- [Model installation](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/modules/model-installation/ollama.ts): `packages/xinity-ai-daemon/src/modules/model-installation/ollama.ts`
- [Model registry](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-daemon/src/modules/model-registry.ts): `packages/xinity-ai-daemon/src/modules/model-registry.ts`

### Platform state

- [PostgreSQL](https://github.com/xinity-ai/xinity-ai/blob/main/packages/common-db/src/connection.ts): `packages/common-db/src/connection.ts`
- [Usage and call data](https://github.com/xinity-ai/xinity-ai/blob/main/packages/common-db/src/schema/call-data.ts): `packages/common-db/src/schema/call-data.ts`
- [Audit and governance](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/audit/audit-sink.ts): `packages/xinity-ai-dashboard/src/lib/server/audit/audit-sink.ts`
- [Metrics and observability](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/lib/server/metrics.ts): `packages/xinity-ai-dashboard/src/lib/server/metrics.ts`

### External interfaces

- [Operations CLI](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-cli/src/lib/act/routes.ts): `packages/xinity-cli/src/lib/act/routes.ts`
- [OpenAPI description](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-ai-dashboard/src/routes/api/openapi.json/%2Bserver.ts): `packages/xinity-ai-dashboard/src/routes/api/openapi.json/+server.ts`

### Model information

- [Model catalog service](https://github.com/xinity-ai/xinity-ai/blob/main/packages/xinity-infoserver/server.ts): `packages/xinity-infoserver/server.ts`

### Other components

- **Operator**
- **API client**
- **Inference engines**

## Connections

- Operator → Management dashboard: manages
- API client → OpenAI gateway: requests inference
- Management dashboard → Authentication and SSO: authenticates
- Management dashboard → Management API: calls management API
- MCP endpoint → Management API: dispatches tools
- Management dashboard → PostgreSQL: reads and writes
- Management dashboard → Usage and call data: queries and rolls up
- Management dashboard → Deployment orchestration: manages deployments
- Deployment orchestration → PostgreSQL: persists configuration
- Management dashboard → Gateway proxy: forwards inference
- Gateway proxy → OpenAI gateway: proxies requests
- OpenAI gateway → Tether bridge: routes to nodes
- Tether bridge → Node daemon: bridges node traffic
- Node daemon → Model installation: manages models
- Node daemon → Inference engines: runs inference
- Node daemon → Model registry: tracks models
- Management dashboard → Compute management: manages capacity
- Management dashboard → Audit and governance: records governance events
- Management dashboard → Metrics and observability: exposes observability
- API client → MCP endpoint: calls tools
- API client → Model catalog service: resolves model metadata
- Model catalog service → Model registry: serves model catalogs
- Operator → Operations CLI: operates platform
- Operations CLI → Management API: discovers routes
- Operator → OpenAPI description: browses API schema