Falk Scholer

Reasoning with Large Language Models for Relevance Judgements

This work presents a novel framework that operationalizes explicit reasoning as a control mechanism for LLM-based relevance judgements and systematically quantifies its effects across evaluation settings, suggesting that its benefits depend on task context and complexity rather than being universally beneficial.