Intent-Description Anchoring Bias in LLM-as-a-Judge Evaluation of Recommender Systems
Large Language Models (LLMs) are increasingly used to evaluate recommendation systems, but are known to exhibit systematic biases. We study whether LLM judges are influenced by descriptions of a recommendation algorithm’s optimization objective, even when evaluating identical recommendation outputs. We find that they a...