Automated Structured Reporting of Neurodegenerative Imaging Markers Using Quantitative MRI and Large Language Models.
TL;DR
The authors' quantitative MRI-to-structured reporting pipeline, integrating quantitative MRI software with large language models with LLM-based conclusion generation, might be feasible for automated structured drafting of neurodegenerative imaging markers.
Abstract
Rationale
AND
Objectives
To evaluate the feasibility of a quantitative magnetic resonance imaging (MRI)-to-structured reporting pipeline that integrates quantitative MRI software with large language models (LLMs) for structured drafting of neurodegenerative imaging markers and generating clinician-facing report conclusions.
Materials And Methods
A total of 192 patients with 3D T1 and 2D or 3D FLAIR MRI images from the Alzheimer's Disease Neuroimaging Initiative database were randomly selected. A deep-learning model generated structured report findings based on nine indices related to brain atrophy, white matter hyperintensities, and cerebrospinal fluid (CSF) space abnormalities, and compared with neuroradiologist-generated reference reports. Four LLMs (GPT-OSS 20B, MedGemma 4B, Phi-3, and Llama 3.1 8B) generated clinician-facing conclusions from the structured findings. Generated conclusions were evaluated using a five-point Likert scale across four metrics (accuracy, relevance, clarity, and satisfaction). Output errors were assessed across four categories: language, omission, addition, and numeric errors.
Results
Structured report findings demonstrated high accuracy for CSF space analysis (77.6%-97.9%). Performance for ordinal visual scales was lower under strict matching (27.1%-57.8%) but improved with a one-grade tolerance (91.7%-97.4%). Among LLMs, GPT achieved the highest scores across most metrics (median score 5) and exhibited the lowest output error rates. Smaller models (Phi-3 and Llama 3.1 8B) showed overall lower performance, with more language, omission, and addition errors. MedGemma demonstrated intermediate performance, but the highest rate of numeric errors.
Conclusion
Our quantitative MRI-to-structured reporting pipeline, integrating quantitative MRI software with LLM-based conclusion generation, might be feasible for automated structured drafting of neurodegenerative imaging markers.
