Skip to content

Almieyar: A Culturally Grounded Benchmark for Multi-Dialect Arabic Speech Recognition

Sep 2026 · arXiv.org · Vol abs/2609.35564 · 0 citations · 19 references
Computer Science

TL;DR

ALMIEYAR is introduced, a culturally grounded ASR benchmark covering 17 Arabic dialects across six families, built entirely from newly recorded speech unseen by existing models, including the first published benchmark for Ahwazi Arabic.

Abstract

Arabic speech technology has largely focused on Modern Standard Arabic, leaving the living dialects spoken by hundreds of millions under-served. We introduce ALMIEYAR, a culturally grounded ASR benchmark covering 17 Arabic dialects across six families, built entirely from newly recorded speech unseen by existing models. Dialect-community coordinators selected culturally relevant images across 10 topics, and native speakers described them through five structured scenarios, yielding approximately 50 minutes per dialect (13.7 hours total). We benchmark 12 state-of-the-art ASR systems zero-shot, including GPT-4o-transcribe, Voxtral-Mini-4B, Fanar-STT-LF, Whisper, SeamlessM4T-v2, and wav2vec2-based models. GPT-4o-transcribe achieves the lowest overall WER at 35.0%, followed by Voxtral-Mini-4B, Fanar-STT-LF, and Whisper-Large-v3 at 41.1%, 45.9%, and 49.5%, respectively, indicating substantial remaining errors across Arabic dialect communities. Performance varies considerably across dialect groups, with no model performing uniformly best across all groups. WER alone also obscures dialectal ASR behaviour: wav2vec2-based models show large WER/CER gaps, where character-level agreement remains much higher than word-level accuracy, motivating joint WER/CER reporting. ALMIEYAR provides a unified benchmark for culturally grounded Arabic ASR evaluation, including the first published benchmark for Ahwazi Arabic.

View source

Similar papers

CARDAMOM: A Micro-Dialectal Arabic Speech Dataset for ASR

Cardamom is presented, a micro-dialectal Arabic speech dataset designed to support fine-grained evaluation and adaptation of automatic speech recognition (ASR) systems, and the collection and annotation process is described, the micro-dialect inventory linguistically is motivated, and four multilingual ASR systems in z...

Bashar Talafha, Samar M. Magdy, Aisha Alansari et al. · 1 citation
#natural language process... Conference Open access Oct 2026

SHAMS: An Audio-Grounded Pronunciation Benchmark for Levantine Arabic

SHAMS (SHami Annotated Multi-dialect Speech), a benchmark comprising 1,300 utterances drawn from open audio corpora, balanced across five LA varieties, is presented, grounded in audio and stratified by variety.

Ben Sapirstein, Roy Mattar, Guy Mor-Lan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

AraYoungVoices: A Diverse L1/L2 Corpus of Arabic Child and Adolescent Speech

State-of-the-art ASR systems primarily target native adult speech, leading to substantial performance gaps for children, adolescents, and L2 speakers. We introduce AraYoungVoices, a 151.72-hour Arabic read-speech corpus from 286 speakers aged 7--18, comprising AraKids (7--12) and AraTeens (13--18). The corpus includes...

S. Chowdhury, Zien Sheikh Ali, H. Lachemat et al. · 1 citation
Preprint Aug 2026

Bulbul: A Dataset for Dialectal Arabic Speech Recognition

BUL, a multi-dialect Arabic ASR dataset collected from 275 speakers in 11 Arab countries, includes structured dialect and sub-dialect coverage, as well as recordings of classical Arabic and modern standard Arabic spoken by participants in their native dialectal accents to support accent-aware modeling.

Ahmed Ashraf, Aisha Alansari, Fadel Al Abbas et al. · 1 citation
#natural language process... Preprint Sep 2026

5-Dialects-BN: Unmasking the Impact of Transliteration on Bangla Dialectal LLMs

Large Language Models (LLMs) have achieved remarkable progress across natural language processing (NLP) tasks, yet their capabilities degrade sharply for low-resource languages and dialectally diverse settings. Bangla, the world's sixth most spoken language, exemplifies this gap: existing resources overwhelmingly targe...

M. Jawad, Galib Mahmud Jim, Rafid Ahmed et al. · 0 citations

VietPrism: A large-scale Vietnamese speech and deepfake corpus with diverse dialects and code-switching

Vietnamese speech research is constrained by resources that isolate automatic speech recognition from speaker, dialect, code-switching, and deepfake analysis. We introduce VietPrism, an open, multi-domain corpus that brings these dimensions together at scale: 993.4 hours and 403,941 bona fide utterances from 1,262 veri...

M. Hoàng, Thai Le · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.