How sroussey/ellmers works
Main System Components
A. Frontend Layer
• Web Interface (packages/web)
• CLI Interface (packages/cli)
B. Core Layer (packages/core)
• Task Management System
• Storage Systems
• Model Management
• Provider System
• Job Queue System
Key Architectural Elements to Highlight
a) Task System (Central to the Architecture):
• It to various task types (Text Generation, Embedding, QA, etc.)
• TaskGraph and TaskGraphRunner components that orchestrate execution
b) Storage Layer:
• Multiple storage backends:
• In-Memory
• SQLite
• PostgreSQL
• IndexedDB
• File System
• Separate repositories for:
• Task Graphs
• Task Outputs
• Key-Value Storage
c) Model Management:
• Supported model types:
• HuggingFace Models
• MediaPipe Models
• GGML Local Models
• Model storage and loading mechanisms
d) Job Queue System:
• Job queue implementations
• Rate limiters and concurrency controls
• To task execution flow
┌─ User Interfaces ─────────────────────┐
• Web UI CLI │
• ┬────────────────────┘
• ↓
┌─ Core Services ──────────────────────────────────┐
• ┌─ Task Management ─┐ ┌─ Model Management ─┐ │
• Task Registry │ │ - HuggingFace │ │
• Task Graph │ │ - MediaPipe │ │
• Task Runner │ │ - GGML Local │ │
• ┘ └──────────────────────┘ │
• ┌─ Job Queue ───────┐ ┌─ Storage ──────────┐ │
• Rate Limiting │ │ - Graph Store │ │
• Concurrency │ │ - Output Store │ │
• ┘ │ - KV Store │ │
• ┘ │
• ┘
Data Flow Indicators
Show:
• User input flow from UI to core
• Task execution flow through the system
• Storage operations
• Model loading and usage
• Job queue processing
Important Details
• Storage backend options for each repository type
• Supported model types and their providers
• Task types and their relationships
• Job queue implementation variants
• System extension points
Specific Implementation Notes
• How the task graph orchestration works
• Relationship between tasks and jobs
• Demonstrate how different storage backends can be swapped
• Document processing pipeline
Remember to:
• Keep components grouped logically
• Clear boundaries between subsystems
• Notes about scalability and extension points