Skip to content

Explainable and Generalisable LLM-based Cognitive Decline Detection with Spontaneous Speech

Sep 2026 · arXiv.org · Vol abs/2609.34217 · 0 citations · 45 references
Computer Science Engineering

TL;DR

This study provides a scalable, objective, and explainable framework for speech-based cognitive screening, combining cognitive status classification with natural language explanations that clinicians can assess and verify, bridging the gap between advanced AI and clinical utility.

Abstract

Alzheimer's disease (AD) and mild cognitive impairment (MCI), which may precede AD, manifest early through subtle linguistic and acoustic alterations. Traditional diagnostics, however, are often resource-intensive and lack scalability for mass screening. To address these challenges, we introduce a novel bilingual speech large language model framework for automated, explainable cognitive screening. Unlike conventional pipelines that rely on error-prone automatic speech recognition, our system directly processes raw speech to learn joint acoustic-semantic representations, preserving critical prosodic cues often lost in transcription. Utilising our newly collected PUTH-AD dataset alongside multiple open-source corpora, we implemented a multi-task learning objective that simultaneously performs cognitive status classification and generates clinician-understandable natural language explanations. Our system achieved the highest average accuracy and AUROC across six dataset/task conditions, comparing three representative baselines. The system demonstrated cross-task transfer to held-out PUTH-AD task subsets, maintaining classification accuracy on an entirely unseen cognitive task without task-specific fine-tuning. Furthermore, clinician evaluation confirms that the generated explanations are both clinically relevant and largely consistent with the underlying speech evidence, supporting their potential utility in clinical interpretation. This study provides a scalable, objective, and explainable framework for speech-based cognitive screening, combining cognitive status classification with natural language explanations that clinicians can assess and verify, bridging the gap between advanced AI and clinical utility.

View source

Similar papers

Why Alzheimer's Speech Screening Fails to Generalize: Bridging the Deployment Gap via Cross-Corpus Evidence Anchoring

This work highlights the need to audit feature transferability and report worst-case domain robustness in cognitive speech screening by proposing a fusion method that integrates XLM-R text baseline scores with evidence anchors selected during training.

Zi-Jian Lu, Si-Zhe Liu, Yin Zhang et al. · 0 citations
#machine learning Preprint Sep 2026

Acoustic Biomarkers for Alzheimer's Disease Detection from Spontaneous Speech

Alzheimer's disease (AD) remains a major public health challenge, and early identification is crucial for timely intervention and care planning. Recent work has shown that speech-based digital biomarkers can capture subtle changes in vocal production, prosody, and timing that often precede or accompany cognitive declin...

A. L. Trần, A. Restar, B. Kindo · 1 citation

Acoustic-based speech chunking techniques for mild cognitive impairment classification

Early and timely intervention is critical for the detection of mild cognitive impairment (MCI) to reduce the progression of dementia. However, traditional diagnostic methods remain time-consuming, resource-intensive, and difficult to scale. Speech-based voice analysis offers a non-invasive and accessible alternative, p...

Nyi Nyein Aung · 0 citations
#artificial intelligence Preprint Aug 2026

Cleaner Speech, Weaker Generalization: Revisiting Pitt-Derived Benchmarks for Alzheimer's Disease Detection

The role of speech preprocessing and dataset curation across widely used benchmarks for speech-based AD detection is revisited, suggesting that ``cleaner''speech datasets are not necessarily more reliable for real-world AD detection.

Lu Sun, Shreeram Suresh Chandra, Lin Zhang et al. · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.