Aug 2026· Journal of Psychopathology and Clinical Science· 0 citations
Medicine
TL;DR
Large language models are best understood as emerging assessment-support tools rather than replacements for clinical evaluation because the limited pace of academic validation means that, at present, LLMs are best understood as emerging assessment-support tools rather than replacements for clinical evaluation.
Abstract
Large language models (LLMs) have shown increasing promise in the mental health field. LLMs are especially well suited to play a role in the labor-intensive, costly process of clinical assessment, as they can interact with a patient or participant directly to conduct a mental health assessment. We conducted a preregistered scoping review to (a) describe the unique capabilities of LLMs for clinical assessment, (b) determine the current state of the field in applying LLMs to directly assess patient/participant mental health (including screening, diagnosis, and monitoring of symptoms), and (c) highlight future research to facilitate the application of LLMs. We included work published in both Chinese and English. Only 10 studies met criteria for direct LLM-based mental health assessment. The evidence base was recent and heterogeneous: Four studies focused primarily on diagnostic interviewing or classification, five on symptom or severity assessment, and one on task-based multimodal depression assessment. Studies varied across text, voice, and multimodal formats, and depression was the dominant target. Across studies, stronger performance tended to be reported in tools that used structured interviewing logic, domain-specific adaptation, and clinically anchored reference standards. However, the evidence base remains small, with many studies employing limited validation procedures, and heavily weighted toward early-stage or nonjournal publications. The limited pace of academic validation means that, at present, LLMs are best understood as emerging assessment-support tools rather than replacements for clinical evaluation. (PsycInfo Database Record (c) 2026 APA, all rights reserved).
Evaluating large language models (LLMs) in the mental health domain presents distinct challenges due to the subtle, context-dependent, and subjective nature of psychological symptoms. We introduce PsyEval, a benchmark specifically designed to evaluate LLMs in mental health-related tasks across three core dimensions: knowledge, diagnosis, and emotional support. PsyEval is constructed to reflect the complexity of mental health scenarios and provides a structured framework for assessing model performance within this sensitive domain. Using PsyEval, we evaluate eleven advanced LLMs with different prompting strategies to investigate how prompting affects their responses. The results reveal considerable gaps in LLMs' current ability to reason accurately and respond appropriately in mental health contexts, while also indicating promising directions for future model enhancement.
Haoan Jin, Siyuan Chen, Dilawaier Dilixiati et al.· npj Mental Health Research· 0 citations
A scoping review of 24 PubMed-indexed studies published between 2023 and 2026 was conducted to assess current applications, benefits, limitations, and future directions of LLMs in healthcare.
Antoni Klamka, Paulina Kawalec, Kamil Bronikowski et al.· Quality in Sport· 0 citations
The extent to which people use general-purpose large language models (LLMs) for their mental health is unknown. Information about use patterns is important for clinicians, developers, and regulators. We surveyed U.S. adults (n = 1871) between August and October 2024 using stratified sampling across age, sex, and race/ethnicity to approximate national demographics. We found that 24% of participants use LLMs for mental health; they are disproportionately young, male, and Black, and have poor mental health. Participants reported difficulty accessing traditional treatment and using LLMs because they are free, convenient, and available. They report using LLMs for emotional support, learning therapy skills, and supplementing existing therapy. Using Pew-reported estimates of population LLM use, we conservatively estimate that as of 2024, 14–18 million U.S. adults may have been using LLMs for mental health. This work highlights the need for monitoring and evaluation to understand the potential harms and benefits of such use.
Elizabeth C. Stade, Zoe M. Tait, Samuel T. Campione et al.· npj Digital Medicine· 1 citation
This review provides a structured overview of recent progress in Med-LLMs by examining their major application areas, key challenges, and emerging future directions.
Yuyang Sha, Li Yu, Zejia Lin et al.· Military Medical Research· 0 citations
The experimental findings indicate that already existing Chinese LLM has some promising prospects in preliminary psychological diagnosis but fails to differentiate semantically similar disorders resulting in diagnostic confusion, and the research of the future should be aimed at enhancing the safety, cultural sensitivity, and clinical reliability of the system.
Aitong He· Scientific Journal of Intell...· 0 citations