Check The Scoreboard: An Analysis of Scoring Schemes on Multiple-Choice Evaluation
It is examined how alternatives to number right change what MCQA measures with six education-inspired schemes that assess abilities beyond accuracy: distractor elimination, abstention, confidence calibration, and self-correction.
Nishant Balepur, Paiheng Xu, Wei Ai et al.
· 0 citations