SUP-MIMIC: A Multi-Task Clinical Diagnosis Benchmark for Evaluating LLMs'Robustness to Contradictory Evidence
SUP-MIMIC is proposed, a multi-task framework utilizing MIMIC-IV-v3.1 that comprises Basic Assessment, Diagnostic Divergence Task (DDT), and Diagnostic Convergence Task (DCT), designed to evaluate the model's"one-to-many"disambiguation capability among phenotypically similar cases, while DCT assesses the model's ability to identify"many-to-one" diagnostic patterns across different pathophysiological pathways
Yi Yu, Bo Wang, Chong Feng et al.
· 0 citations