Old Ideas, Novel Problems: The Instability of LLM-Based Novelty Evaluation
Automated ideation systems are often evaluated on the novelty of the ideas they produce, and that judgment is increasingly delegated to large language models. Such judges are typically built ad hoc and validated, if at all, on human-authored papers rather than on the generated ideas they are meant to score. So, how do...
Noy Sternlicht, Simra Shahid, P. Jansen et al.
· 0 citations