kaggle/kaggle-benchmarks

Kaggle Benchmarks is a Python framework for defining and running evaluations of language models. The principal workflow is: a user defines a task, runs it over parameters or dataset rows, the task interacts with a model, assertions validate results, and runs can be recorded for review. The library also supports structured and multimodal inputs, tool use, parallel evaluation, and interactive notebook views. Sampled source confirms task registration, chat creation, schema processing, event dispatch, and Kaggle file persistence; some integration wiring is not shown, so uncertain links are omitted.