Niantong Li

OmniJudge or OmniBias? Diagnosing Multimodal Judges through Balanced, Decoupled Lenses

D3-Omni is introduced, a balanced and decoupled benchmark for diagnosing fine-grained multimodal understanding, covering 53 orthogonal binary dimensions and 10,671 samples across the three tasks, suggesting that aggregate accuracy may hide systematic blind spots that a balanced and decoupled lens can help expose and, i...