How runllm/aqueduct works
Main Components
a. Core System Components:
• Server Component (src/golang/cmd/server)
• Executor Component (src/python/aqueduct_executor)
• SDK Component (sdk/)
• UI Component (src/ui/)
• Storage Layer (src/golang/lib/storage)
b. External Integration Points:
• Cloud Infrastructure Connectors
• Database Connectors
• Computing Resources (Kubernetes, AWS Lambda, Spark)
• Authentication Systems
Key Architectural Patterns
• Microservices Architecture (separate components for server, executor, UI)
• Plugin Architecture (for resource connectors)
• Event-driven Architecture (for workflow execution)
• RESTful API Architecture (for client-server communication)
[Web UI] -----> [SDK/Python Client]
[API Server (Go)] <---> [Workflow Engine] <---> [Executor Service]
[Resource Connectors] <---> [Compute Engine] <---> [Storage Engine]
[Cloud Infrastructure] [Databases] [Computing Resources]
Specific Implementation Details
• Workflow Definition Flow
• Execution Path
• Data Movement
• Resource Management
• Authentication Flow
Key Components Detail
Server:
[API Server]
• Request Handler
• Authentication
• Workflow Manager
• Resource Controller
Executor:
[Executor Service]
• Function Executor
• Connector Handlers
• System Metrics
• Parameter Handler
Resource Management:
[Resource Layer]
• Database Connectors
• Cloud Storage
• Compute Resources
• Authentication