How superlinked/sie works
SIE is a self-hosted inference platform: clients submit embedding, generation, extraction, and related model tasks; server runtimes execute model work, while an optional gateway manages cluster-facing APIs and worker pools. The repository also provides SDKs, MCP tools, and framework/vector-store integrations. The graph preserves documented task families and major control-plane capabilities; some internal links are dashed because the relevant handler and routing implementations were not excerpted.
Main entry points: server.rs Gateway HTTP server · model_worker.py Model workers · sie_sdk Python SDK · api Inference APIs
Components 18
Inference runtime
- Inference APIs
packages/sie_server/src/sie_server/api - Encoding pipeline
packages/sie_server/src/sie_server/core/encode_pipeline.py - Model workers
packages/sie_server/src/sie_server/core/worker/model_worker.py - Model adapters
packages/sie_server/src/sie_server/adapters - Engine configuration
packages/sie_server/src/sie_server/config/engine.py - Inference sidecar
packages/sie_server_sidecar/src/local_ingest.rs - Batch scheduler
packages/sie_server_sidecar/src/scheduler/engine.rs
Cluster control plane
- Gateway HTTP server
packages/sie_gateway/src/server.rs - Gateway handlers
packages/sie_gateway/src/handlers - Pool management
packages/sie_gateway/src/state/pool_manager.rs - Gateway configuration
packages/sie_gateway/src/config.rs - NATS config sync
packages/sie_gateway/src/nats/manager.rs
Client interfaces
- Python SDK
packages/sie_sdk/src/sie_sdk - TypeScript SDK
packages/sie_ts_sdk/src/client.ts - MCP tools
packages/sie_mcp/src/sie_mcp/server.py
Framework integrations
- Framework adapters
integrations
Other components
- Agent or app
- NATS
Connections 14
- Agent or app → Inference APIs: submits tasks
README.md - Inference APIs → Encoding pipeline: dispatches encoding
- Encoding pipeline → Model workers: uses worker handlers
packages/sie_server/src/sie_server/core/encode_pipeline.py - Model workers → Model adapters: invokes adapters
packages/sie_server/src/sie_server/core/worker/model_worker.py - Engine configuration → Model workers: configures runtime
- Inference sidecar → Batch scheduler: dispatches batches
- Gateway HTTP server → Gateway handlers: routes requests
packages/sie_gateway/src/server.rs - Gateway HTTP server → Pool management: manages pools
packages/sie_gateway/src/server.rs - Gateway HTTP server → Gateway configuration: loads settings
packages/sie_gateway/src/server.rs - NATS → NATS config sync: publishes config
packages/sie_gateway/src/nats/manager.rs - Agent or app → Python SDK: calls
README.md - Agent or app → TypeScript SDK: calls
- MCP tools → Python SDK: uses client
packages/sie_mcp/src/sie_mcp/server.py - Framework adapters → Python SDK: wraps client
README.md