How kimdanny/matm works
MATM lets producer agents contribute action-observation trajectories to a shared index, then lets consumer agents retrieve relevant segments during task execution. The runtime selects an environment and retrieval policy, adds retrieved context to agent decisions, and records outcomes; online memory can add runtime trajectories back to the repository. The README also documents an LTR reranking and training-data pipeline. Edges reflect README statements and SOURCE INDEX references; unsampled implementation details are not assumed.
Main entry points: run_evaluation.py ALFWorld runner · run_webarena.py WebArena runner · retrieval_strategy.py Retrieval manager · preprocess Trajectory staging and indexing
Components 25
Agent runtime
- ALFWorld runner
traj_retrieval/run_evaluation.py - WebArena runner
traj_retrieval/run_webarena.py - Async episode loop
traj_retrieval/core/async_with_traj_rag.py - Sync episode loop
traj_retrieval/core/sync_with_traj_rag.py - Async action policies
traj_retrieval/strategies/async_strategies.py - Sync action policies
traj_retrieval/strategies/sync_strategies.py - Async retrieval handler
traj_retrieval/core/retrieval_handler.py - Sync retrieval handler
traj_retrieval/core/retrieval_handler_sync.py - Retrieval manager
traj_retrieval/core/retrieval_strategy.py
Trajectory memory
- Trajectory search
traj_retrieval/core/lancedb_retrieval.py - LanceDB index
traj_retrieval/core/lancedb_client.py - ALFWorld online memory
traj_retrieval/core/alfworld_online_memory.py - WebArena online memory
traj_retrieval/core/webarena_online_memory.py - Trajectory staging and indexing
traj_retrieval/preprocess
Task environments
- Environment factory
traj_retrieval/core/environment_factory.py - Environment interface
traj_retrieval/core/base_handler.py - ALFWorld handler
traj_retrieval/core/alfworld_handler.py - WebArena handler
traj_retrieval/core/webarena_handler.py
Ranking and evaluation
- LTR feature extraction
ltr/runtime_features.py - LTR rankers
ltr/models/base.py - LTR training data
traj_retrieval/evaluation/ltr_data - Evaluation and metrics
traj_retrieval/evaluation/evaluate_trajectories.py - Reranker orchestration
traj_retrieval/core/reranker_orchestrator.py
Other components
- Producer agents
- Consumer agents
Connections 33
- Producer agents → Trajectory staging and indexing: contribute trajectories
README.md - Trajectory staging and indexing → LanceDB index: build shared index
README.md - Consumer agents → ALFWorld runner: start evaluation
README.md - ALFWorld runner → Async episode loop: runs episodes
traj_retrieval/run_evaluation.py - ALFWorld runner → Environment factory: creates environments
traj_retrieval/run_evaluation.py - ALFWorld runner → Retrieval manager: configures retrieval
traj_retrieval/run_evaluation.py - ALFWorld runner → ALFWorld online memory: commits trajectories
traj_retrieval/run_evaluation.py - ALFWorld runner → Evaluation and metrics: collects metrics
traj_retrieval/run_evaluation.py - Consumer agents → WebArena runner: start evaluation
README.md - WebArena runner → Sync episode loop: runs episodes
traj_retrieval/run_webarena.py - WebArena runner → Environment factory: creates environments
traj_retrieval/run_webarena.py - WebArena runner → Retrieval manager: configures retrieval
traj_retrieval/run_webarena.py - WebArena runner → WebArena online memory: commits trajectories
traj_retrieval/run_webarena.py - WebArena runner → Evaluation and metrics: collects metrics
traj_retrieval/run_webarena.py - Async episode loop → Async retrieval handler: uses retrieval
traj_retrieval/core/async_with_traj_rag.py - Async episode loop → Async action policies: selects policy
traj_retrieval/core/async_with_traj_rag.py - Sync episode loop → Sync retrieval handler: uses retrieval
traj_retrieval/core/sync_with_traj_rag.py - Sync episode loop → Sync action policies: selects policy
traj_retrieval/core/sync_with_traj_rag.py - Environment factory → Environment interface: implements interface
traj_retrieval/core/environment_factory.py - ALFWorld handler → Environment interface: implements interface
traj_retrieval/core/alfworld_handler.py - WebArena handler → Environment interface: implements interface
traj_retrieval/core/webarena_handler.py - Async retrieval handler → Retrieval manager: requests retrieval
traj_retrieval/core/retrieval_handler.py - Sync retrieval handler → Retrieval manager: requests retrieval
traj_retrieval/core/retrieval_handler_sync.py - Retrieval manager → Trajectory search: selects search
traj_retrieval/core/retrieval_strategy.py - Trajectory search → LanceDB index: queries index
- ALFWorld online memory → Trajectory staging and indexing: formats trajectories
traj_retrieval/core/alfworld_online_memory.py - WebArena online memory → Trajectory staging and indexing: formats trajectories
traj_retrieval/core/webarena_online_memory.py - LTR training data → LTR feature extraction: prepares ranking features
- LTR feature extraction → LTR rankers: scores candidates
README.md - Retrieval manager → Reranker orchestration: reranks results
README.md - Reranker orchestration → LTR rankers: uses trained rankers
README.md - LTR training data → LTR rankers: trains rankers
README.md - Evaluation and metrics → LTR training data: supports training data
README.md