Jaiveer Bassi

Do Published HumanEval Rankings Survive Local Deployment?

Benchmark software, a preregistered protocol, completed five-model primary artifacts, controls, a StarCoder2 stopping-rule ablation, and a technical report testing whether the HumanEval ranking in Qwen2.5-Coder Table 5 survives local deployment.