DeltaSelect: Affordable A/B Testing for Coding Agents
The paper presents DeltaSelect, an open-source method that identifies tasks whose one-run results consistently track full-benchmark performance using Pearson correlation, maps fractional verifier results to a common score using linear regression, and selects a fixed task set within a dollar budget.
Nicholas J. Conn
· 0 citations