# arttessstt/llm_orchestrator architecture

> Architecture diagram of the GitHub repository arttessstt/llm_orchestrator, generated by GitDiagram from its file tree, README and a sample of source files (last updated 2026-11-16). It is an AI-made overview: check details against the source.

- Interactive diagram: https://gitdiagram.com/arttessstt/llm_orchestrator
- Repository: https://github.com/arttessstt/llm_orchestrator

## Overview

This is a C++ LLM console/orchestration application: a user starts a terminal dialogue, which sends prompts to a configured model and returns responses; optional tool mode executes model-requested tools and continues the turn. Profile catalogs support selecting providers and fallback chains, while a demo order calculator adds a domain-specific tool. The excerpts show the CLI dispatch and interfaces, but not all implementation-level routing, dialogue, or tool-loop calls; uncertain links are omitted or marked unverified.

Main entry points: [`src/main.cpp`](https://github.com/arttessstt/llm_orchestrator/blob/main/src/main.cpp) (CLI entry), [`src/CloudProvider.cpp`](https://github.com/arttessstt/llm_orchestrator/blob/main/src/CloudProvider.cpp) (Chat API adapter), [`include/IProvider.hpp`](https://github.com/arttessstt/llm_orchestrator/blob/main/include/IProvider.hpp) (Provider interface), [`src/Dialogue.cpp`](https://github.com/arttessstt/llm_orchestrator/blob/main/src/Dialogue.cpp) (Dialogue session)

## Diagram (Mermaid)

```mermaid
flowchart TD

subgraph group_app["Console dialogue"]
  node_cli["CLI entry<br/>[main.cpp]"]
  node_dialogue["Dialogue session<br/>[Dialogue.cpp]"]
end

subgraph group_providers["Model providers"]
  node_core["Conversation types<br/>[Types.hpp]"]
  node_provider_api["Provider interface<br/>[IProvider.hpp]"]
  node_cloud["Chat API adapter<br/>[CloudProvider.cpp]"]
end

subgraph group_tools["Tool execution"]
  node_tool_loop["Tool turn loop<br/>[ToolLoop.cpp]"]
  node_registry["Tool registry<br/>[ToolRegistry.cpp]"]
  node_order["Order calculation"]
end

subgraph group_profiles["Profiles and routing"]
  node_profile_config["Profile catalog<br/>[ProfileConfig.cpp]"]
  node_config_loader["Environment config<br/>[ConfigLoader.cpp]"]
  node_router["Provider router<br/>[ProviderRouter.cpp]"]
  node_fallback["Fallback orchestration"]
end

node_user(("Terminal user"))
node_model_api{{"OpenAI-compatible API"}}

node_user -->|"starts session"| node_cli
node_cli -->|"runs dialogue"| node_dialogue
node_cli -->|"loads profiles"| node_profile_config
node_cli -->|"loads config"| node_config_loader
node_cli -->|"creates provider"| node_cloud
node_cli -->|"creates registry"| node_registry
node_cli -->|"registers demo"| node_order
node_dialogue -->|"runs tool turns"| node_tool_loop
node_tool_loop -->|"invokes tools"| node_registry
node_tool_loop -->|"requests generation"| node_provider_api
node_cloud -->|"sends requests"| node_model_api
node_cloud -->|"implements"| node_provider_api
node_profile_config -->|"builds providers"| node_cloud
node_profile_config -->|"prepares chain"| node_router
node_router -->|"implements"| node_provider_api
node_fallback -->|"implements"| node_provider_api
node_order -.->|"registers tool"| node_registry
node_dialogue -.->|"uses provider"| node_provider_api
node_config_loader -.->|"configures client"| node_cloud

click node_cli "https://github.com/arttessstt/llm_orchestrator/blob/main/src/main.cpp"
click node_dialogue "https://github.com/arttessstt/llm_orchestrator/blob/main/src/Dialogue.cpp"
click node_core "https://github.com/arttessstt/llm_orchestrator/blob/main/include/Types.hpp"
click node_provider_api "https://github.com/arttessstt/llm_orchestrator/blob/main/include/IProvider.hpp"
click node_cloud "https://github.com/arttessstt/llm_orchestrator/blob/main/src/CloudProvider.cpp"
click node_profile_config "https://github.com/arttessstt/llm_orchestrator/blob/main/src/ProfileConfig.cpp"
click node_config_loader "https://github.com/arttessstt/llm_orchestrator/blob/main/src/ConfigLoader.cpp"
click node_router "https://github.com/arttessstt/llm_orchestrator/blob/main/src/ProviderRouter.cpp"
click node_fallback "https://github.com/arttessstt/llm_orchestrator/blob/main/src/FallbackOrchestrator.cpp"
click node_tool_loop "https://github.com/arttessstt/llm_orchestrator/blob/main/src/ToolLoop.cpp"
click node_registry "https://github.com/arttessstt/llm_orchestrator/blob/main/src/ToolRegistry.cpp"
click node_order "https://github.com/arttessstt/llm_orchestrator/blob/main/src/OrderCalculation.cpp"

classDef toneNeutral fill:#f8fafc,stroke:#334155,stroke-width:1.5px,color:#0f172a
classDef toneBlue fill:#dbeafe,stroke:#2563eb,stroke-width:1.5px,color:#172554
classDef toneAmber fill:#fef3c7,stroke:#d97706,stroke-width:1.5px,color:#78350f
classDef toneMint fill:#dcfce7,stroke:#16a34a,stroke-width:1.5px,color:#14532d
classDef toneRose fill:#ffe4e6,stroke:#e11d48,stroke-width:1.5px,color:#881337
classDef toneIndigo fill:#e0e7ff,stroke:#4f46e5,stroke-width:1.5px,color:#312e81
classDef toneTeal fill:#ccfbf1,stroke:#0f766e,stroke-width:1.5px,color:#134e4a
class node_cli,node_dialogue,node_user toneBlue
class node_core,node_provider_api,node_cloud toneAmber
class node_tool_loop,node_registry,node_order,node_model_api toneMint
class node_profile_config,node_config_loader,node_router,node_fallback toneRose
```

## Components

### Console dialogue

- [CLI entry](https://github.com/arttessstt/llm_orchestrator/blob/main/src/main.cpp): `src/main.cpp`
- [Dialogue session](https://github.com/arttessstt/llm_orchestrator/blob/main/src/Dialogue.cpp): `src/Dialogue.cpp`

### Model providers

- [Conversation types](https://github.com/arttessstt/llm_orchestrator/blob/main/include/Types.hpp): `include/Types.hpp`
- [Provider interface](https://github.com/arttessstt/llm_orchestrator/blob/main/include/IProvider.hpp): `include/IProvider.hpp`
- [Chat API adapter](https://github.com/arttessstt/llm_orchestrator/blob/main/src/CloudProvider.cpp): `src/CloudProvider.cpp`

### Tool execution

- [Tool turn loop](https://github.com/arttessstt/llm_orchestrator/blob/main/src/ToolLoop.cpp): `src/ToolLoop.cpp`
- [Tool registry](https://github.com/arttessstt/llm_orchestrator/blob/main/src/ToolRegistry.cpp): `src/ToolRegistry.cpp`
- [Order calculation](https://github.com/arttessstt/llm_orchestrator/blob/main/src/OrderCalculation.cpp): `src/OrderCalculation.cpp`

### Profiles and routing

- [Profile catalog](https://github.com/arttessstt/llm_orchestrator/blob/main/src/ProfileConfig.cpp): `src/ProfileConfig.cpp`
- [Environment config](https://github.com/arttessstt/llm_orchestrator/blob/main/src/ConfigLoader.cpp): `src/ConfigLoader.cpp`
- [Provider router](https://github.com/arttessstt/llm_orchestrator/blob/main/src/ProviderRouter.cpp): `src/ProviderRouter.cpp`
- [Fallback orchestration](https://github.com/arttessstt/llm_orchestrator/blob/main/src/FallbackOrchestrator.cpp): `src/FallbackOrchestrator.cpp`

### Other components

- **Terminal user**
- **OpenAI-compatible API**

## Connections

- Terminal user → CLI entry: starts session (evidence: `src/main.cpp`)
- CLI entry → Dialogue session: runs dialogue (evidence: `src/main.cpp`)
- CLI entry → Profile catalog: loads profiles (evidence: `src/main.cpp`)
- CLI entry → Environment config: loads config (evidence: `src/main.cpp`)
- CLI entry → Chat API adapter: creates provider (evidence: `src/main.cpp`)
- CLI entry → Tool registry: creates registry (evidence: `src/main.cpp`)
- CLI entry → Order calculation: registers demo (evidence: `src/main.cpp`)
- Dialogue session → Tool turn loop: runs tool turns (evidence: `src/Dialogue.cpp`)
- Tool turn loop → Tool registry: invokes tools (evidence: `src/ToolLoop.cpp`)
- Tool turn loop → Provider interface: requests generation (evidence: `src/ToolLoop.cpp`)
- Chat API adapter → OpenAI-compatible API: sends requests (evidence: `src/CloudProvider.cpp`)
- Chat API adapter → Provider interface: implements
- Profile catalog → Chat API adapter: builds providers (evidence: `src/ProfileConfig.cpp`)
- Profile catalog → Provider router: prepares chain (evidence: `src/ProfileConfig.cpp`)
- Provider router → Provider interface: implements
- Fallback orchestration → Provider interface: implements
- Order calculation → Tool registry: registers tool
- Dialogue session → Provider interface: uses provider
- Environment config → Chat API adapter: configures client
