CruxBench: A Benchmark of Information Discovery
CruxBench is introduced, a benchmark that grades LLM-generated questions by their Value of Information (VOI): how much a model-proposed crux updates beliefs about a target forecasting question and finds that VOI correlates highly with independent measures of model capability and captures cruxes'usefulness for answering...
Hui Dai, Li-Na Piao, Nick Merrill et al.
· 0 citations