How continual-intelligence/seal works
SEAL trains language models to generate self-edits—finetuning data and update directives—in response to new inputs. Its documented domains are factual-knowledge incorporation and few-shot task adaptation. In the ARC workflow, task examples are represented and augmented, prompts are prepared for inference, and candidate outputs are combined and evaluated; self-editing additionally generates update configurations and applies model updates. The factual-knowledge branch includes question-data generation, continual self-edits, inner-loop servers, and querying. Some latter modules are indexed but unsampled, so their internal behavior and connections are shown only where documented or referenced.
Main entry points: self-edit.py Self-edit loop · utils.py Model API utilities · ttt.py Task adaptation · preprocess.py Inference preprocessing
Components 26
Few-shot adaptation
- Self-edit loop
few-shot/self-edit.py - Task adaptation
few-shot/ttt.py - Model inference
few-shot/inference/engine.py - Inference variants
few-shot/inference/engine_vllm.py - No-LoRA inference
few-shot/inference/engine_no_lora.py - Model updates
few-shot/arclib/update_model.py
ARC task components
- ARC tasks
few-shot/arclib/arc.py - Task representation
few-shot/arclib/representers.py - Message formatting
few-shot/arclib/messagers.py - Task augmentation
few-shot/arclib/augmenters.py - Inference preprocessing
few-shot/inference/preprocess.py - Output voting
few-shot/arclib/voting.py - Task evaluation
few-shot/arclib/eval.py
Factual knowledge
- Question data
general-knowledge/src/data_generation/make_squad_data.py - Continual self-edits
general-knowledge/src/continual/continual_self_edits.py - GA inner server
general-knowledge/src/inner/GA_server.py - TTT inner server
general-knowledge/src/inner/TTT_server.py - Knowledge queries
general-knowledge/src/query/query_server.py - CPT with GA
general-knowledge/src/query/CPT_GA.py - CPT full finetune
general-knowledge/src/query/CPT_fullFT.py - CPT querying
general-knowledge/src/query/CPT.py
Shared model services
- Model API utilities
general-knowledge/src/utils.py - Language-model API
few-shot/utils/lm_api.py
Other components
- Experimenter
- Language model
- OpenAI API
Connections 29
- Experimenter → Self-edit loop: starts adaptation
- Experimenter → Continual self-edits: starts knowledge edits
- Self-edit loop → ARC tasks: reads tasks
few-shot/self-edit.py - Self-edit loop → Task representation: configures formats
few-shot/self-edit.py - Self-edit loop → Message formatting: formats messages
few-shot/self-edit.py - Self-edit loop → Task augmentation: configures edits
few-shot/self-edit.py - Self-edit loop → Inference preprocessing: preprocesses tasks
few-shot/self-edit.py - Self-edit loop → Model inference: requests generations
few-shot/self-edit.py - Self-edit loop → Model updates: applies updates
few-shot/self-edit.py - Self-edit loop → Output voting: combines candidates
few-shot/self-edit.py - Self-edit loop → Task evaluation: evaluates outputs
few-shot/self-edit.py - Task adaptation → Task representation: uses representations
few-shot/ttt.py - Task adaptation → Message formatting: uses formatting
few-shot/ttt.py - Task adaptation → Model updates: updates model
few-shot/ttt.py - Inference preprocessing → ARC tasks: transforms tasks
few-shot/inference/preprocess.py - Inference preprocessing → Task augmentation: applies transforms
few-shot/inference/preprocess.py - Model inference → Language model: generates tokens
- Inference variants → Language model: generates tokens
- No-LoRA inference → Language model: generates tokens
- Continual self-edits → Question data: loads question data
general-knowledge/src/continual/continual_self_edits.py - Continual self-edits → Model API utilities: uses utilities
general-knowledge/src/continual/continual_self_edits.py - GA inner server → Model API utilities: uses utilities
general-knowledge/src/inner/GA_server.py - TTT inner server → Model API utilities: uses utilities
general-knowledge/src/inner/TTT_server.py - Knowledge queries → Model API utilities: uses utilities
general-knowledge/src/query/query_server.py - CPT with GA → Model API utilities: uses utilities
general-knowledge/src/query/CPT_GA.py - CPT full finetune → Model API utilities: uses utilities
general-knowledge/src/query/CPT_fullFT.py - CPT querying → Model API utilities: uses utilities
- Model API utilities → OpenAI API: requests completions
general-knowledge/src/utils.py - Language-model API → OpenAI API: calls API