How harbor-framework/terminal-bench-science works
Terminal-Bench-Science is a scientific-workflow benchmark: contributors propose, implement, and review tasks, then researchers run those tasks with AI agents or oracle solutions and compare results. The repository primarily contains task packages across five scientific domains; Harbor, the leaderboard, and task dashboard are external services. The README documents the lifecycle and benchmark workflow, but sampled source does not show a central runner or results pipeline, so those internal links are intentionally omitted.
Main entry points: tasks Propose Task · rubric_review.py Task Review · life-sciences Life Sciences · physical-sciences Physical Sciences
Components 16
Task Contribution
- Propose Task
tasks - Build Task
tasks - Task Review
ci_checks/rubric_review.py
Benchmark Tasks
- Life Sciences
tasks/life-sciences - Physical Sciences
tasks/physical-sciences - Earth Sciences
tasks/earth-sciences - Mathematical Sciences
tasks/mathematical-sciences - Engineering Sciences
tasks/engineering-sciences
Benchmark Use
- Harbor Runner
- AI Agents
- Oracle Solutions
tasks
Project Tracking
- Leaderboard
- Task Dashboard
- Tagged Releases
Other components
- Researchers
- Task Contributors
Connections 15
- Task Contributors → Propose Task: submit proposal
README.md - Propose Task → Build Task: approved proposals
README.md - Build Task → Task Review: opens pull request
README.md - Researchers → Harbor Runner: run benchmark
README.md - Harbor Runner → AI Agents: evaluates
README.md - Harbor Runner → Oracle Solutions: runs solutions
README.md - Harbor Runner → Life Sciences: loads tasks
- Harbor Runner → Physical Sciences: loads tasks
- Harbor Runner → Earth Sciences: loads tasks
- Harbor Runner → Mathematical Sciences: loads tasks
- Harbor Runner → Engineering Sciences: loads tasks
- Researchers → Leaderboard: compare results
README.md - Task Contributors → Task Dashboard: track progress
README.md - Researchers → Task Dashboard: browse coverage
README.md - Researchers → Tagged Releases: browse releases
README.md