How akashagarwalind/trimproof works
trimproof is a Go gateway that conditionally re-encodes eligible LLM request data, forwards requests to Anthropic or OpenAI-compatible providers, and validates responses. Its principal workflow is route selection and identity, four transformation gates, provider forwarding, and optional Tier 1 validation. Shadow evaluation and promotion use paired provider calls to decide whether a route should enable or disable optimization. Audit, metrics, token calibration, and operator reporting are supporting capabilities. Some wiring is documented in the README; unsampled implementation details and uncertain links are omitted.
Main entry points: server.go HTTP gateway · shadow.go Shadow evaluator · gates.go Four gates · calibrate.go Token calibrator
Components 23
Gateway runtime
- Gateway process
cmd/gateway/main.go - HTTP gateway
pkg/server/server.go - Identity handling
pkg/server/identity.go - Route registry
pkg/server/registry.go - Provider adapters
pkg/provider/anthropic/anthropic.go - OpenAI adapter
pkg/provider/openai/openai.go
Encoding and gates
- Four gates
pkg/policy/gates.go - TOONX codec
pkg/codec/toonx/toonx.go - TOONX decoder
pkg/codec/toonx/decode.go - Token estimates
pkg/tokens/tokens.go
Validation and identity
- Tier 1 validation
pkg/validator/validator.go - Scope authorization
pkg/validator/authz.go
Evaluation and promotion
- Shadow evaluator
pkg/eval/shadow.go - Evaluation pairs
pkg/eval/store.go - Route promoter
pkg/eval/promotion.go
Observability and reporting
- Audit pipeline
pkg/audit/audit.go - OTel metrics
pkg/audit/metrics.go - Token calibrator
pkg/calibrate/calibrate.go - Report CLI
cmd/trimproof/main.go - Report builder
internal/report/report.go
Other components
- LLM client
- LLM providers
- Anthropic counter
Connections 28
- LLM client → HTTP gateway: sends request
README.md - HTTP gateway → Identity handling: checks identity
pkg/server/server.go - HTTP gateway → Route registry: looks up route
pkg/server/server.go - HTTP gateway → Four gates: decides transforms
pkg/server/server.go - Four gates → TOONX codec: encodes eligible data
pkg/policy/gates.go - Four gates → Token estimates: estimates savings
pkg/policy/gates.go - HTTP gateway → Provider adapters: parses and renders
pkg/server/server.go - HTTP gateway → OpenAI adapter: routes OpenAI API
pkg/server/server.go - HTTP gateway → LLM providers: forwards request
pkg/server/server.go - LLM providers → HTTP gateway: returns response
README.md - HTTP gateway → Tier 1 validation: validates response
README.md - Tier 1 validation → Scope authorization: checks tool scope
pkg/validator/authz.go - TOONX codec → TOONX decoder: verifies round trip
pkg/codec/toonx/toonx.go - Gateway process → HTTP gateway: starts gateway
cmd/gateway/main.go - Gateway process → Shadow evaluator: starts evaluator
cmd/gateway/main.go - HTTP gateway → Shadow evaluator: observes exchanges
pkg/eval/shadow.go - Shadow evaluator → LLM providers: runs paired calls
pkg/eval/shadow.go - Shadow evaluator → Evaluation pairs: stores pairs
pkg/eval/shadow.go - Shadow evaluator → Route promoter: evaluates route
pkg/eval/shadow.go - Route promoter → Route registry: reads route state
pkg/eval/promotion.go - HTTP gateway → Audit pipeline: emits exchanges
pkg/audit/audit.go - HTTP gateway → OTel metrics: reports metrics
README.md - HTTP gateway → Token calibrator: observes requests
pkg/calibrate/calibrate.go - Token calibrator → Anthropic counter: requests token counts
pkg/calibrate/calibrate.go - Token calibrator → Token estimates: corrects estimates
pkg/calibrate/calibrate.go - Report CLI → Report builder: builds report
cmd/trimproof/main.go - Report builder → Evaluation pairs: reads evaluation pairs
internal/report/report.go - Report builder → Audit pipeline: summarizes audit log
internal/report/report.go