How Often Do Large Language Models Agree with Each Other—And with the Truth? A Consensus- and Complexity-Stratified Analysis of Data Extraction for Neuroimaging AI
It is shown that LLM-assisted extraction in neuroimaging AI is a complexity-stratified workflow design problem: low-complexity neuroimaging variables may be selectively automated, while medium-complexity variables require rapid verification, and high-complexity methodological variables should remain human-led.