Cost-Aware Best-LLM Identification using Dueling Feedback
A Track-and-Stop style algorithm for best-arm identification with prescribed confidence is proposed, and it is proved that the algorithm almost surely achieves the asymptotically optimal cost as the error tends to zero.