How anurag1734/xrlvr works
X-RLVR is an interpretability study and tooling for comparing a base language model with an RLVR-trained model on text reversal. The main workflow takes prompts, loads both models, computes attention, attribution, saliency and logit-lens results, summarizes metrics, and writes comparison visualizations. The README also documents SFT followed by RL training through PRIME-RL; this repository provides a CLI wrapper and configuration files rather than the trainer implementation. Edges reflect the sampled analysis CLI and documented training handoff; training internals are external.
Main entry points: analyze.py Analysis CLI · train.py Training CLI · visualization.py Comparison Dashboard · sft.toml SFT Config
Components 17
Model Training
- Training CLI
src/xrlvr/cli/train.py - SFT Config
configs/sft.toml - RL Config
configs/rl.toml - PRIME-RL Trainer
Analysis Inputs
- Analysis CLI
src/xrlvr/cli/analyze.py - Model Repository
- Base and RL Models
- Prompt Batch
src/xrlvr/data.py
Interpretability
- Attention Analysis
src/xrlvr/analysis.py - Integrated Gradients
src/xrlvr/analysis.py - Gradient Saliency
src/xrlvr/analysis.py - Logit Lens
src/xrlvr/analysis.py
Metrics and Results
- Metric Calculations
src/xrlvr/metrics.py - Metric Summary
src/xrlvr/metrics.py - Comparison Dashboard
src/xrlvr/visualization.py - Analysis Outputs
Other components
- Researcher
Connections 16
- Researcher → Training CLI: starts training
- Training CLI → SFT Config: passes config
- Training CLI → RL Config: passes config
- Training CLI → PRIME-RL Trainer: dispatches SFT or RL
- Researcher → Analysis CLI: provides prompts and models
- Analysis CLI → Model Repository: loads model and tokenizer
- Model Repository → Base and RL Models: provides weights
- Analysis CLI → Prompt Batch: prepares prompts
- Analysis CLI → Attention Analysis: requests attention
- Analysis CLI → Integrated Gradients: requests attributions
- Analysis CLI → Gradient Saliency: requests saliency
- Analysis CLI → Logit Lens: requests layer decoding
- Analysis CLI → Metric Calculations: computes comparisons
- Analysis CLI → Metric Summary: records metrics
- Analysis CLI → Comparison Dashboard: builds dashboard
- Comparison Dashboard → Analysis Outputs: writes plots