How arttessstt/llm_orchestrator works
This is a C++ LLM console/orchestration application: a user starts a terminal dialogue, which sends prompts to a configured model and returns responses; optional tool mode executes model-requested tools and continues the turn. Profile catalogs support selecting providers and fallback chains, while a demo order calculator adds a domain-specific tool. The excerpts show the CLI dispatch and interfaces, but not all implementation-level routing, dialogue, or tool-loop calls; uncertain links are omitted or marked unverified.
Main entry points: main.cpp CLI entry · CloudProvider.cpp Chat API adapter · IProvider.hpp Provider interface · Dialogue.cpp Dialogue session
Components 14
Console dialogue
- CLI entry
src/main.cpp - Dialogue session
src/Dialogue.cpp
Model providers
- Conversation types
include/Types.hpp - Provider interface
include/IProvider.hpp - Chat API adapter
src/CloudProvider.cpp
Tool execution
- Tool turn loop
src/ToolLoop.cpp - Tool registry
src/ToolRegistry.cpp - Order calculation
src/OrderCalculation.cpp
Profiles and routing
- Profile catalog
src/ProfileConfig.cpp - Environment config
src/ConfigLoader.cpp - Provider router
src/ProviderRouter.cpp - Fallback orchestration
src/FallbackOrchestrator.cpp
Other components
- Terminal user
- OpenAI-compatible API
Connections 19
- Terminal user → CLI entry: starts session
src/main.cpp - CLI entry → Dialogue session: runs dialogue
src/main.cpp - CLI entry → Profile catalog: loads profiles
src/main.cpp - CLI entry → Environment config: loads config
src/main.cpp - CLI entry → Chat API adapter: creates provider
src/main.cpp - CLI entry → Tool registry: creates registry
src/main.cpp - CLI entry → Order calculation: registers demo
src/main.cpp - Dialogue session → Tool turn loop: runs tool turns
src/Dialogue.cpp - Tool turn loop → Tool registry: invokes tools
src/ToolLoop.cpp - Tool turn loop → Provider interface: requests generation
src/ToolLoop.cpp - Chat API adapter → OpenAI-compatible API: sends requests
src/CloudProvider.cpp - Chat API adapter → Provider interface: implements
- Profile catalog → Chat API adapter: builds providers
src/ProfileConfig.cpp - Profile catalog → Provider router: prepares chain
src/ProfileConfig.cpp - Provider router → Provider interface: implements
- Fallback orchestration → Provider interface: implements
- Order calculation → Tool registry: registers tool
- Dialogue session → Provider interface: uses provider
- Environment config → Chat API adapter: configures client