How qwenlm/qwen2.5-coder works
This repository combines Qwen3-Coder fine-tuning workflows with a collection of coding, reasoning, and tool-use evaluation suites; it is not a single end-user application. The training branch prepares data and runs supervised or preference optimization. Evaluation branches generate model outputs, execute or grade them, and produce benchmark results. The README describes the model’s coding-agent, long-context, and tool-calling capabilities, while the tree shows dedicated evaluation suites for those areas. Connections below follow the README or shown source references; most unsampled benchmark internals are represented at their existing directory paths.
Main entry points: aider/main.py Aider entry point · sft/train.py SFT training · dpo/train.py DPO training · bird-spider/main.py Bird-Spider runner
Components 24
Model training
- SFT training
finetuning/sft/train.py - SFT data prep
finetuning/sft/utils/training_datasets.py - DPO training
finetuning/dpo/train.py - DPO utilities
finetuning/dpo/utils.py
Coding evaluation
- Aider entry point
qwencoder-eval/instruct/aider/aider/main.py - Coder engine
qwencoder-eval/instruct/aider/aider/coders/base_coder.py - Model registry
qwencoder-eval/instruct/aider/aider/models.py - Repository context
qwencoder-eval/instruct/aider/aider/repo.py - Conversation dump
qwencoder-eval/instruct/aider/aider/dump.py - Issue reporting
qwencoder-eval/instruct/aider/aider/report.py - Bird-Spider runner
qwencoder-eval/instruct/bird-spider/main.py - SQL evaluation
qwencoder-eval/instruct/bird-spider/code_eval/evaluator.py - LiveCodeBench runner
qwencoder-eval/instruct/livecode_bench/lcb_runner/runner/main.py - Scenario routing
qwencoder-eval/instruct/livecode_bench/lcb_runner/runner/scenario_router.py - Multilingual execution
finetuning/sft/utils/multiple_metrics/evaluation.py
Reasoning evaluation
- CRUXEval inference
qwencoder-eval/instruct/cruxeval/inference/main.py - CoT benchmark runner
qwencoder-eval/reasoning/livecode_bench_cot/lcb_runner_cq/runner/main.py - CoT scenario routing
qwencoder-eval/reasoning/livecode_bench_cot/lcb_runner_cq/runner/scenario_router.py
Agent evaluation
- BFCL inference
qwencoder-eval/tool_calling_eval/berkeley-function-call-leaderboard/bfcl_eval/_llm_response_generation.py - BFCL model handler
qwencoder-eval/tool_calling_eval/berkeley-function-call-leaderboard/bfcl_eval/model_handler/base_handler.py - Local model serving
qwencoder-eval/tool_calling_eval/berkeley-function-call-leaderboard/bfcl_eval/model_handler/local_inference/base_oss_handler.py - Retail task scenarios
qwencoder-eval/tool_calling_eval/tau-bench/tau_bench/envs/retail/tasks.py - Tau API router
qwencoder-eval/tool_calling_eval/tau-bench/tau_bench/model_utils/api/router.py
Other components
- Model engineer
Connections 22
- Model engineer → SFT training: trains
finetuning/sft/train.py - Model engineer → DPO training: trains
finetuning/dpo/train.py - SFT training → SFT data prep: loads data
finetuning/sft/train.py - DPO training → DPO utilities: uses utilities
finetuning/dpo/train.py - Model engineer → Aider entry point: uses coding agent
- Aider entry point → Model registry: registers models
qwencoder-eval/instruct/aider/aider/main.py - Aider entry point → Coder engine: creates coder
qwencoder-eval/instruct/aider/aider/main.py - Aider entry point → Repository context: configures repository
qwencoder-eval/instruct/aider/aider/main.py - Aider entry point → Conversation dump: imports dump
qwencoder-eval/instruct/aider/aider/main.py - Aider entry point → Issue reporting: imports reporting
qwencoder-eval/instruct/aider/aider/main.py - Model engineer → Bird-Spider runner: runs benchmark
qwencoder-eval/instruct/bird-spider/main.py - Bird-Spider runner → SQL evaluation: uses evaluator
qwencoder-eval/instruct/bird-spider/main.py - Model engineer → LiveCodeBench runner: runs benchmark
qwencoder-eval/instruct/livecode_bench/lcb_runner/runner/main.py - LiveCodeBench runner → Scenario routing: routes scenarios
qwencoder-eval/instruct/livecode_bench/lcb_runner/runner/main.py - Model engineer → Multilingual execution: runs execution metrics
- Model engineer → CRUXEval inference: runs reasoning tests
qwencoder-eval/instruct/cruxeval/inference/main.py - Model engineer → CoT benchmark runner: runs reasoning benchmark
qwencoder-eval/reasoning/livecode_bench_cot/lcb_runner_cq/runner/main.py - CoT benchmark runner → CoT scenario routing: routes scenarios
qwencoder-eval/reasoning/livecode_bench_cot/lcb_runner_cq/runner/main.py - Model engineer → BFCL inference: runs tool tests
- BFCL model handler → Local model serving: extended by
qwencoder-eval/tool_calling_eval/berkeley-function-call-leaderboard/bfcl_eval/model_handler/local_inference/base_oss_handler.py - Model engineer → Retail task scenarios: runs agent tasks
- Model engineer → Tau API router: uses API evaluation