How adevinta/zoe works
Main Components
The system has three main modules that should be prominently featured:
a. zoe-cli (Command Interface)
• Entry point for user interactions
• Command handling and parsing
• Configuration management
b. zoe-core (Core Functionality)
• Base functions for Kafka operations
• JSON utilities
• Polling and producing capabilities
c. zoe-service (Service Layer)
• Runner implementations (Kubernetes, Lambda, Local)
• Secret management
• Expression handling
• Storage operations
External Integration Points
Integration with:
• Kafka clusters
• Kubernetes clusters
• AWS Lambda
• Secret management systems (AWS Secrets Manager, Strongbox)
┌─ User Interface Layer ─────────────────────┐
• Zoe CLI │
• (Commands, Config, Aliases, Topics) │
• ┤
• Zoe Core │
• (Kafka Operations, JSON Utils, Functions) │
• ┤
• Zoe Service │
• (Runners, Secrets, Storage, Config) │
• ┤
• Execution Layer │
• ┌─────────┐ ┌──────────┐ ┌──────────┐ │
• Local │ │Kubernetes│ │ Lambda │ │
• ┘ └──────────┘ └──────────┘ │
• ┘
Key Relationships
a. Control Flow:
• CLI → Core → Service → Runners → Kafka
• Config management flow
• Secret resolution flow
b. Data Flow:
• Kafka data consumption/production paths
• Configuration loading paths
• Runner execution paths
Important Details
a. Runner Architecture:
• How different runners (Kubernetes, Lambda, Local) interact
• Parallel execution capabilities
• Scaling mechanisms
b. Configuration Management:
• Config initialization flow
• Environment handling
• Default configurations
c. Security Layer:
• Secret management integration
• Authentication flows
• Access control