JudgeMoE: Distributional Aggregation for LLM-as-a-Judge
JudgeMoE, a lightweight aggregator that assigns example-specific weights to cached judge score distributions and fuses them before computing a final score is introduced, showing that score-range choice is unstable across judge--dataset settings and that soft scoring usually outperforms hard decoding.