Jul 2026
CollabEval: Statistically Efficient Collaborative Model Evaluation via Matrix Completion
This work proposes Collaborative Evaluation (CollabEval), a simple, effective, and principled method for exploiting dependencies between historical runs of different models on the same tasks to improve statistical efficiency.
Adam Fisch, Daniel Deutsch, Joshua Maynez et al.
· arXiv.org · 2 citations