Skip to content

TranslatePsy-AfriSLM: High-Quality Data Scaling For Low-Resource Machine Translation

Aug 2026 · 0 citations · 48 references
Computer Science

TL;DR

This paper introduces *TranslatePsy-AfriSLM*, a collection of open-source MT resources for 19 Sub-Saharan African languages, including curated parallel data, African-specialized synthetic data, and a family of fine-tuned SLMs.

Abstract

The rapid progress in Artificial Intelligence has largely bypassed African languages, creating a digital divide that limits AI adoption on the continent. Recent open-source LLMs systematically underperform on African language machine translation, while the lack of large-scale, high-quality, open-source parallel data has constrained the development of competitive small language models (SLMs). We introduce TranslatePsy-AfriSLM, a collection of open-source machine translation resources for 19 Sub-Saharan African languages, including curated parallel data, African-specialized synthetic data, and a family of fine-tuned SLMs. Our empirical study shows that unified quality-estimation filtering removes up to 96% of training tokens without degrading quality, and that filtered synthetic data dominates the quality-efficiency Pareto frontier. Fine-tuned on the resulting data mixture, TranslatePsy-AfriSLMs outperform substantially larger systems, including TranslateGemma-27B and Qwen3.5-122B-A10B, with as few as 0.8B parameters.

View source

Similar papers

Open access Jul 2026

Transliteration for Low-Resource Translation in the Age of Large Language Models

The findings show that manual transliteration consistently yields the best translation performance, while noisy automatic romanization reduces these gains, and that LLM-based translation can be competitive with, and in some settings outperform, fine-tuned NMT systems, although this advantage comes with lower interpreta...

A. Mansurova, Meruert Bekmukhamedova, Bekarys Baibolat et al. · 0 citations
Review Open access Aug 2026

Bridging the AI Language Divide: A Systematic Review of NMT and LLMs in Low-Resource Translation

The findings reveal that model performance is highly dependent on resource availability: transformer-based NMT excels in moderate data settings, while LLMs demonstrate promising zero-shot and few-shot capabilities in extremely low-resource scenarios.

Sweet Agrawal, A. Agbeyangi · 0 citations

A Factorial Study of Synthetic Data Generation for Low-Resource Machine Translation using Grammar Books

A pipeline that uses large language models to extract grammatical rules, example sentences, and lexicons from grammar books and generate synthetic parallel corpora for fine-tuning-rather than feeding grammar content into prompts at inference time, as in prior work is introduced.

V. Ravikumar, Sina Ahmadi, L. Jäger et al. · 0 citations
Preprint Jul 2026

Translation as a Computationally Efficient Bridge: Feasibility of English BERT for Low-Resource Languages

Evaluating the feasibility of translation-based fine-tuning across six NLP tasks demonstrates that translation-based fine-tuning offers a scalable, resource-efficient, and empirically validated path for extending NLP to low-resource languages while advancing linguistic inclusivity and sustainability in artificial intel...

H. Muizelaar, Giulia Rivetti, Marco Spruit et al. · 0 citations
Review Open access 2026

Advancing Large Language Models for Low-Resource Languages: A Systematic Review of Pretraining, Adaptation, and Ethical Challenges

This systematic review examines recent progress in the pretraining and adaptation of LLMs for Low-Resource Languages (LRLs) and focuses on the ethics in AI practice, the development of corpora through communities, and interdisciplinary research collaboration among computational linguists, social scientists, and digital...

Ismail Hossain, Mridul Banik, Fahmid Al Farid et al. · 0 citations

Related blog posts

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.