How templierpaul/qdax_es works
High-Level Components
a) Core Framework Layer:
• Core containers and emitters as sub-components
b) Algorithm Layer:
• This above the core layer
• Implemented algorithms (JEDi, ES, MEES, CMAME)
• Connections to their respective emitters
c) Environment Integration Layer:
• This on the right side
• Brax and Kheperax integration points
• To the core framework
d) Configuration & Pipeline Layer:
• This on the left side
• Hydra configuration system
• Weights & Biases (W&B) integration
Component Relationships
a) Data Flow:
• Configuration → Core Framework
• Core Framework → Environments
• Emitters → Containers
• Algorithms → Emitters
b) Dependencies:
Specific Implementation Details
Key architectural elements:
a) Core Components:
Containers/
• Count Repertoire
• GP Repertoire
• MAE Repertoire
• Novelty Archive
Emitters/
• CMA-ME
• JEDi
• MEES
• Base Emitter
b) Factory Pattern:
• Factories (cmame.py, es.py, jedi.py, etc.) as intermediaries
• Them to their respective algorithms
Important Notes
• Modular nature of the emitter system
• Extensibility points for new algorithms
• Configuration system's role in experiment management
• Integration points with external libraries (Evosax, Brax, Kheperax)
Technical Details
• Python-based implementation
• Hydra configuration management
• W&B integration for experiment tracking
• Support for various environment types
• Multiple algorithm implementations