Prompt Lottery in LLM-as-a-Judge: Measuring and Mitigating Sensitivity to Syntactic Rephrasing
It is shown that multi-prompt aggregation substantially improves robustness by emphasizing judgments that remain consistent across prompt variants, and it is shown that multi-prompt aggregation substantially improves robustness by emphasizing judgments that remain consistent across prompt variants.