How quantumnous/new-api works
New API is a self-hosted AI gateway: a client sends a model request through its API, the gateway selects a configured upstream channel, adapts the request and response, and accounts for usage. Separate product branches manage channels and model pricing, user access, asynchronous task plugins, and the web console. The README documents these capabilities; sampled source confirms the embedding relay’s conversion, upstream request, and quota-accounting steps. Other subsystem links reflect documented roles, not inspected call sites.
Main entry points: relay Protocol handlers · src Web console · relay.go Relay entry · billing.go Usage settlement
Components 23
Model gateway
- API routes
router/relay-router.go - Relay entry
controller/relay.go - Protocol handlers
relay - Protocol conversion
relaykit/relayconvert
Channels and models
- Channel selection
service/channel_select.go - Channel management
controller/channel.go - Model configuration
controller/model.go - Provider adapters
relay/channel
Usage and billing
- Usage settlement
service/billing.go - Pricing rules
pkg/billingexpr - Usage records
model/log.go - Payment integrations
service/webhook.go
Access and console
- Users and keys
controller/user.go - Authentication
middleware/auth.go - Permissions
service/authz - Web console
web/src
Tasks and integrations
- Task API
controller/task.go - Plugin runtime
pkg/jsplugin - Task plugins
plugins/tasks - Task records
model/task.go
Other components
- API client
- Model providers
- Payment providers
Connections 19
- API client → API routes: sends request
- API routes → Relay entry: dispatches
- Relay entry → Authentication: checks access
- Relay entry → Protocol handlers: dispatches
- Protocol handlers → Channel selection: selects channel
- Protocol handlers → Protocol conversion: converts payload
- Protocol handlers → Provider adapters: uses adapter
- Provider adapters → Model providers: sends request
- Protocol handlers → Usage settlement: reports usage
- Usage settlement → Pricing rules: evaluates pricing
- Usage settlement → Usage records: records usage
- Web console → Channel management: configures channels
- Web console → Model configuration: configures models
- Web console → Users and keys: manages accounts
- Web console → Permissions: manages permissions
- Task API → Plugin runtime: invokes hooks
- Plugin runtime → Task plugins: loads plugins
- Task API → Task records: stores task state
- Payment integrations → Payment providers: integrates payments