This work studies evidence-conditioned relational reasoning in isolation, with the facts supplied directly in the prompt rather than retrieved, suggesting that greater model capability does not by itself ensure reliable reasoning over supplied relational evidence.
Zohreh Abbasi Liasi, Batoul Hammoud, Anas Madkoor et al.· 1 citation
ALMIEYAR is introduced, a culturally grounded ASR benchmark covering 17 Arabic dialects across six families, built entirely from newly recorded speech unseen by existing models, including the first published benchmark for Ahwazi Arabic.
Omid Ghahroodi, Anas Madkoor, Dima Faris Alsaudi et al.· arXiv.org· 0 citations
The QuranicMMLU offers a rigorous, linguistically grounded framework for evaluating Arabic NLP in the Quranic domain and benchmark 12 systems on these items find that the Islamic-specialized model leads, yet every system scores higher on multiple-choice accuracy than open-ended answer quality.
R. El Ghali, Umm Kulsoom, Anas Madkoor et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.