How amit024/freellmapi works
FreeLLMAPI aggregates free and custom model endpoints behind an OpenAI-compatible API. The main runtime path is a client request through the server’s mounted API routes, routing and quota checks, then a provider adapter and upstream service; the server also persists configuration and usage state. The README documents dashboard key management, catalog updates, multimodal endpoints, and prompt compression. Some subsystem links are documented capabilities rather than inspected call sites, so those are marked dashed or left out.
Main entry points: router.ts Request router · app.ts HTTP application · proxy.ts Chat API routes · keys.ts Key management
Components 20
Client access
- Management dashboard
client/src/App.tsx - API client library
client/src/lib/api.ts
API surfaces
- HTTP application
server/src/app.ts - Chat API routes
server/src/routes/proxy.ts - Anthropic API
server/src/routes/anthropic.ts - Responses API
server/src/routes/responses.ts - Key management
server/src/routes/keys.ts
Routing and providers
- Request router
server/src/services/router.ts - Provider registry
server/src/providers/index.ts - Provider adapters
server/src/providers/base.ts - Provider quota
server/src/services/provider-quota.ts - Rate-limit state
server/src/services/ratelimit.ts
Keys and state
- SQLite state
server/src/db/index.ts - Key encryption
server/src/lib/crypto.ts
Model capabilities
- Catalog sync
server/src/services/catalog-sync.ts - Media and embeddings
server/src/services/media.ts - Prompt compression
server/src/services/compression/pipeline.ts
Other components
- API client
- Model providers
- Signed catalog feed
Connections 22
- API client → HTTP application: sends requests
README.md - Management dashboard → API client library: uses API
- HTTP application → Chat API routes: mounts routes
server/src/app.ts - HTTP application → Anthropic API: mounts routes
server/src/app.ts - HTTP application → Responses API: mounts routes
server/src/app.ts - HTTP application → Key management: mounts routes
server/src/app.ts - Chat API routes → Request router: dispatches requests
- Anthropic API → Request router: dispatches requests
- Responses API → Request router: dispatches requests
- Request router → Provider registry: resolves provider
server/src/services/router.ts - Request router → Rate-limit state: checks limits
server/src/services/router.ts - Request router → Provider quota: checks quota
server/src/services/router.ts - Provider registry → Provider adapters: selects adapter
- Provider adapters → Model providers: forwards inference
README.md - Provider adapters → Provider quota: updates quota
server/src/providers/base.ts - Provider quota → SQLite state: reads and writes
server/src/services/provider-quota.ts - Rate-limit state → SQLite state: reads and writes
server/src/services/ratelimit.ts - Key management → SQLite state: manages keys
- Key management → Key encryption: encrypts keys
README.md - Catalog sync → Signed catalog feed: fetches updates
README.md - API client → Media and embeddings: requests media or embeddings
README.md - Chat API routes → Prompt compression: compresses prompts