Skip to content
Preprint

Speaker Role and Language Diarization for Analyzing Multilingual Interviews for Language Proficiency of Older Adults

Aug 2026 · 0 citations · 32 references
Engineering

TL;DR

Whisper-based speaker-role and language diarization systems to automatically extract respondent speech and characterize language usage in multilingual interviews with older adults and whether diarization-derived conversational and language-use behaviors can support downstream language proficiency assessment are developed.

Abstract

Automatic language proficiency assessment in the context of multilingual interview-based settings remains underexplored. In this work, we develop Whisper-based speaker-role and language diarization systems to automatically extract respondent speech and characterize language usage in multilingual interviews with older adults. We further investigate whether diarization-derived conversational and language-use behaviors can support downstream language proficiency assessment. Results show that language-adapted Whisper models substantially improve language diarization performance for lower-resource and linguistically related Indian languages. Statistical analyses reveal that respondent speech ratio and intended language usage are strong predictors of proficiency ratings. Furthermore, simple diarization-derived behavioral features achieve performance comparable to Whisper-based speech embeddings for proficiency prediction, while combining both yields the best results. Importantly, both the speech and language use statistical analyses and language proficiency prediction performance remain largely preserved when using fully automatic diarization outputs, demonstrating the potential of respondent-centric conversational analysis for scalable language proficiency assessment.

View source

Similar papers

Open access Sep 2026

Assessing the use of automatic speech recognition and large language models for individuals with language impairments

This work systematically evaluates edge-oriented ASR-LLM pipelines for individuals with language impairments using comparison studies and ablation experiments across aphasia, child language impairment, and dementia datasets to identify transcript errors, repetition, noise, and input length as factors affecting system p...

Ge-Lei Xu, Hao-Tong Yu, Li-Xuan Wei et al. · 0 citations

Language Discrimination Improves Linguistic Learning in Multilingual Speech Models

It is shown that strengthening the model's ability to discriminate languages during pretraining reduces and, on some measures, closes this multilingual gap on continuous phonetic and higher-level linguistic measures, while preserving substantial cross-language sharing.

Maureen de Seyssel, Jie Chi, Zakaria Aldeneh · 0 citations
#natural language process... Conference Open access Sep 2026

Assessing the Impact of Language Disparity on Multilingual Linguistic Ability in Large Language Models

Claims about the grammatical competence of multilingual language models vary sharply with how competence is measured, yet the interaction between evaluation paradigm, post-training, and language resource availability has not been systematically examined. We evaluate base and post-trained models from six families on Mul...

Zhan-Yu Chen, Jaap Jumelet · 0 citations
Open access Oct 2026

AI-Based Computational Modeling of Language and Communication Difficulties among School-Age Learners

The findings support the Multidomain Linguistic Difficulty Computational Screening Model (MLD-CSM) as a reliable and scalable framework for identifying learners who may require further language and communication assessment, particularly in multilingual educational settings with limited specialist resources.

Uzma Khan · 0 citations
Review Open access Sep 2026

The role of native language translation in English language acquisition

: This study investigates the role of native language (L1) transfer in English language acquisition among Chinese learners, employing a questionnaire–based survey of 329 participants across different proficiency levels. The findings indicate that L1 influence operates across multiple domains, with the most substantial...

Jian Zhong · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.