The LALA Benchmark: Evaluating Literary and Linguistic Analysis in LLMs
We introduce the Literature and Linguistics Analysis Benchmark (LALA), comprising 236 open-ended questions written by experts in linguistics and literary studies, together with expert-provided ideal answers. By comparing models within families and at similar training scales using human and LLM judges, LALA identifies d...
Michael Foster, Barbara McGillivray, Gard B. Jenset et al.
· 0 citations