Aug 2026· Journal of Psychopathology and Clinical Science· 0 citations
Medicine
TL;DR
Large language models are best understood as emerging assessment-support tools rather than replacements for clinical evaluation because the limited pace of academic validation means that, at present, LLMs are best understood as emerging assessment-support tools rather than replacements for clinical evaluation.
Abstract
Large language models (LLMs) have shown increasing promise in the mental health field. LLMs are especially well suited to play a role in the labor-intensive, costly process of clinical assessment, as they can interact with a patient or participant directly to conduct a mental health assessment. We conducted a preregistered scoping review to (a) describe the unique capabilities of LLMs for clinical assessment, (b) determine the current state of the field in applying LLMs to directly assess patient/participant mental health (including screening, diagnosis, and monitoring of symptoms), and (c) highlight future research to facilitate the application of LLMs. We included work published in both Chinese and English. Only 10 studies met criteria for direct LLM-based mental health assessment. The evidence base was recent and heterogeneous: Four studies focused primarily on diagnostic interviewing or classification, five on symptom or severity assessment, and one on task-based multimodal depression assessment. Studies varied across text, voice, and multimodal formats, and depression was the dominant target. Across studies, stronger performance tended to be reported in tools that used structured interviewing logic, domain-specific adaptation, and clinically anchored reference standards. However, the evidence base remains small, with many studies employing limited validation procedures, and heavily weighted toward early-stage or nonjournal publications. The limited pace of academic validation means that, at present, LLMs are best understood as emerging assessment-support tools rather than replacements for clinical evaluation. (PsycInfo Database Record (c) 2026 APA, all rights reserved).
This work introduces PsyEval, a benchmark specifically designed to evaluate LLMs in mental health-related tasks across three core dimensions: knowledge, diagnosis, and emotional support, and reveals considerable gaps in LLMs' current ability to reason accurately and respond appropriately in mental health contexts.
Haoan Jin, Siyuan Chen, Dilawaier Dilixiati et al.· npj Mental Health Research· 0 citations
A scoping review of 24 PubMed-indexed studies published between 2023 and 2026 was conducted to assess current applications, benefits, limitations, and future directions of LLMs in healthcare.
Antoni Klamka, Paulina Kawalec, Kamil Bronikowski et al.· Quality in Sport· 0 citations
The extent to which people use general-purpose large language models (LLMs) for their mental health is unknown. Information about use patterns is important for clinicians, developers, and regulators. We surveyed U.S. adults (n = 1871) between August and October 2024 using stratified sampling across age, sex, and race/e...
Elizabeth C. Stade, Zoe M. Tait, Samuel T. Campione et al.· npj Digital Medicine· 2 citations
This review provides a structured overview of recent progress in Med-LLMs by examining their major application areas, key challenges, and emerging future directions.
Yuyang Sha, Li Yu, Zejia Lin et al.· Military Medical Research· 0 citations
The experimental findings indicate that already existing Chinese LLM has some promising prospects in preliminary psychological diagnosis but fails to differentiate semantically similar disorders resulting in diagnostic confusion, and the research of the future should be aimed at enhancing the safety, cultural sensitivi...
Aitong He· Scientific Journal of Intell...· 0 citations
Current evidence indicates that LLMs have substantial potential to enhance healthcare delivery, research, and personalized medicine, but they should currently be regarded as supportive tools rather than autonomous clinical decision-makers.
Antoni Klamka, Paulina Kawalec, Kamil Bronikowski et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.