This study provides a scalable, objective, and explainable framework for speech-based cognitive screening, combining cognitive status classification with natural language explanations that clinicians can assess and verify, bridging the gap between advanced AI and clinical utility.
Abstract
Alzheimer's disease (AD) and mild cognitive impairment (MCI), which may precede AD, manifest early through subtle linguistic and acoustic alterations. Traditional diagnostics, however, are often resource-intensive and lack scalability for mass screening. To address these challenges, we introduce a novel bilingual speech large language model framework for automated, explainable cognitive screening. Unlike conventional pipelines that rely on error-prone automatic speech recognition, our system directly processes raw speech to learn joint acoustic-semantic representations, preserving critical prosodic cues often lost in transcription. Utilising our newly collected PUTH-AD dataset alongside multiple open-source corpora, we implemented a multi-task learning objective that simultaneously performs cognitive status classification and generates clinician-understandable natural language explanations. Our system achieved the highest average accuracy and AUROC across six dataset/task conditions, comparing three representative baselines. The system demonstrated cross-task transfer to held-out PUTH-AD task subsets, maintaining classification accuracy on an entirely unseen cognitive task without task-specific fine-tuning. Furthermore, clinician evaluation confirms that the generated explanations are both clinically relevant and largely consistent with the underlying speech evidence, supporting their potential utility in clinical interpretation. This study provides a scalable, objective, and explainable framework for speech-based cognitive screening, combining cognitive status classification with natural language explanations that clinicians can assess and verify, bridging the gap between advanced AI and clinical utility.
This work highlights the need to audit feature transferability and report worst-case domain robustness in cognitive speech screening by proposing a fusion method that integrates XLM-R text baseline scores with evidence anchors selected during training.
Findings support temporal speech instability as a dynamic speech biomarker for robust, interpretable, and generalisable early detection of cognitive decline.
Madhurananda Pahar, Caitlin H. Illingworth, Dorota Braun et al.· 1 citation
Alzheimer's disease (AD) remains a major public health challenge, and early identification is crucial for timely intervention and care planning. Recent work has shown that speech-based digital biomarkers can capture subtle changes in vocal production, prosody, and timing that often precede or accompany cognitive declin...
Early and timely intervention is critical for the detection of mild cognitive impairment (MCI) to reduce the progression of dementia. However, traditional diagnostic methods remain time-consuming, resource-intensive, and difficult to scale. Speech-based voice analysis offers a non-invasive and accessible alternative, p...
The role of speech preprocessing and dataset curation across widely used benchmarks for speech-based AD detection is revisited, suggesting that ``cleaner''speech datasets are not necessarily more reliable for real-world AD detection.
Lu Sun, Shreeram Suresh Chandra, Lin Zhang et al.· 0 citations
The Pause-Augmented for Disfluency Markers framework was developed, a novel preprocessing approach that explicitly encodes speech disfluencies as special tokens, preserving them for consumption by the classifiers.