Muhammed Emre Çolak

Minos: apparatus, parser and per-case captures for "Evaluation harness choices bias the measured tool-use capability of open-weight large language models"

The complete artifact behind the study of harness-induced bias in tool-use evaluation of open-weight large language models: the benchmark apparatus, the model-agnostic multi-dialect call parser, the scorers, every analysis and figure script, and the raw per-case capture logs. The study follows a run-once, re-parse-many...