How project-arbr/arbr-control-plane works
Arbr is a self-hosted model-optimization and governance control plane. Applications send requests through its compatible gateway, which classifies and routes traffic to providers while recording request outcomes. The console and recommendation engine turn that history into savings opportunities; representative traffic can be evaluated before a human approves a reversible rule, shadow run, or guarded canary. Post-rollout requested-versus-served records support verification. The README documents the product lifecycle and capabilities; some subsystem links below are documented there because their source was not sampled.
Main entry points: handler.js Request handling · api.js Console API client · App.jsx Console application · RequestRecord.js Request records
Components 24
Traffic gateway
- OpenAI-compatible gateway
server/src/gateway/openaiCompat.js - Request handling
server/src/gateway/handler.js - Workload classification
server/src/classify/classifier.js - Provider connections
server/src/providers/connections.js - Provider dispatch
server/src/providers/router.js - Model and pricing registry
server/src/pricing/registry.js
Optimization evidence
- Request records
server/src/models/RequestRecord.js - Usage analytics
server/src/analytics/aggregate.js - Savings recommendations
server/src/recommend/engine.js - Candidate evaluation
server/src/eval/replay.js - Evaluation worker
server/src/eval/worker.js
Governance controls
- Routing policies
server/src/routing/ruleEngine.js - Canary monitoring
server/src/routing/canaryEngine.js - Budget enforcement
server/src/routing/capEngine.js - Runtime settings
server/src/models/Settings.js - Request database context
server/src/db/context.js
Operator console
- Console application
web/src/App.jsx - Console API client
web/src/api.js - Routing controls
web/src/pages/Routing.jsx - Evaluation console
web/src/pages/ModelEvals.jsx - Application insights
web/src/pages/Applications.jsx
Client access
- Gateway clients
clients/js/src/index.js
Other components
- AI application
- Model providers
Connections 32
- AI application → Gateway clients: sends requests
README.md - AI application → OpenAI-compatible gateway: sends requests
README.md - Gateway clients → OpenAI-compatible gateway: calls gateway
README.md - OpenAI-compatible gateway → Request handling: dispatches requests
server/src/index.js - Request handling → Workload classification: classifies workload
server/src/gateway/handler.js - Request handling → Routing policies: selects route
server/src/gateway/handler.js - Request handling → Provider dispatch: dispatches call
server/src/gateway/handler.js - Provider dispatch → Provider connections: resolves credentials
server/src/providers/router.js - Provider dispatch → Model providers: calls provider
README.md - Request handling → Model and pricing registry: prices request
server/src/gateway/handler.js - Request handling → Request records: records outcome
- Request records → Usage analytics: aggregated by
- Usage analytics → Savings recommendations: informs discovery
README.md - Request records → Savings recommendations: reads traffic
server/src/recommend/engine.js - Savings recommendations → Candidate evaluation: builds evidence
README.md - Candidate evaluation → Evaluation worker: runs evaluation
server/src/eval/worker.js - Routing policies → Runtime settings: reads mode
server/src/routing/ruleEngine.js - Request handling → Budget enforcement: enforces caps
server/src/gateway/handler.js - Request handling → Canary monitoring: checks canary
server/src/gateway/handler.js - Canary monitoring → Runtime settings: uses configuration
- Console application → Console API client: loads API
web/src/App.jsx - Console application → Routing controls: routes to
web/src/App.jsx - Console application → Evaluation console: routes to
web/src/App.jsx - Console API client → Routing policies: configures routing
- Console API client → Savings recommendations: manages opportunities
- Console API client → Candidate evaluation: manages evaluations
- Console application → Application insights: routes to
web/src/App.jsx - Application insights → Console API client: loads app data
web/src/pages/Applications.jsx - Routing controls → Console API client: updates controls
web/src/pages/Routing.jsx - Evaluation console → Console API client: manages evaluations
web/src/pages/ModelEvals.jsx - Request database context → Runtime settings: scopes model access
server/src/models/Settings.js - Request database context → Request records: scopes model access