Question Selection and Answer Scoring Shape Revision Risk in Recurrent Language Models
An evaluation of early answers must choose which questions to release and how to read their answers. Using one scoring convention for both choices can make two procedures look similar while concealing their sensitivity to either choice. We measured this dependence on stored trajectories from Huginn and Ouro, using cloz...