Skip to content

SalamandraTA at WMT 2026 Terminology Shared Task: Hard Examples Are Better Teachers

Sep 2026 · 0 citations · 31 references
Computer Science

Abstract

Terminology-aware translation asks for more than a correct translation: the output must use the exact terms a glossary prescribes. The standard recipe, fine-tuning on glossary-annotated translation pairs, hides an inefficiency: for most examples the glossary prescribes exactly what the model would have produced anyway, so they teach nothing about following a glossary. We therefore keep only the examples where the model's own translation contradicts the glossary. In a controlled study at fixed data volume, this selection alone raises term accuracy from 78.7% to 89.9%. The filtered data, built by a two-way synthetic pipeline on open models, is part of the instruction-tuning mixture of our public release SalamandraTA-7b-instruct v3.0, which, used exactly as released and wrapped in a document-level inference pipeline, forms the BSC submission to the WMT26 Terminology Shared Task Track 1. At the official WMT26 evaluation, our system achieves 94.2% term success at 74.6 chrF++, with only two of the twenty-two submissions outperforming it on both metrics. On last year's benchmark, it also surpasses our GRPO-based system, despite being trained solely with ordinary supervised fine-tuning.

View source

Similar papers

#natural language process... Preprint Sep 2026

In the Blind: Building Pseudo-References for MT Evaluation

The WMT26 General MT task evaluates systems on 10 language pairs that have no human references (neither translated from scratch nor post-edited from MT output by humans) and how the pseudo-references were built is described.

Diptesh Kanojia, Chi-Kiu Lo, Archchana Sindhujan et al. · 0 citations
#artificial intelligence Preprint Oct 2026

The Instruction Tax on Factual Recall: Base Models Can Beat Their Instruction-Tuned Counterparts

It is shown that the prompting methodology is as important as the model architecture: while the instruction-tuned model version achieves 0.5681 with its chat interface, the base model achieves 0.6836 when prompted using text completion, which decreases factual recall.

Christophe Khalil, Aya Mourad · 0 citations
#artificial intelligence Preprint Sep 2026

Is Human-Readable Text Necessary for Effective LLM Fine-Tuning?

Desired-Update-Aligned Synthetic Data (DASA), which uses activation-gradient feedback from a frozen reference model to guide the optimization of continuous synthetic input embeddings, inspired by the role of activation gradients in local risk reduction, targets useful adaptation updates rather than source-text reconstr...

Jin-Hao Zhang, Ze-Yu Liu, Zi-Cheng Yan et al. · 0 citations
#natural language process... Preprint Sep 2026

FACET at WMT 2026 Automated Translation Quality Evaluation Task

FACET, the authors' reference-free submission to the WMT26 Automated Translation Quality Evaluation Task, is presented, which decomposes evaluation into Fluency, Accuracy, and Consistency passes and gives each pass only the context its error type requires.

Ahrii Kim, Chanjun Park, Seong-heum Kim · 0 citations
Preprint Oct 2026

Task-Preserving Multilingual Instruction Tuning for Open-Ended QA in WMT 2026 MIST

This paper describes our submission to the WMT 2026 Multilingual Instruction Shared Task. We adapt Qwen3-8B with LoRA using organiser-provided data, EuroAlpaca, a multilingual instruction dataset created through task-preserving localisation, and CrossEuroAlpaca, a cross-lingual augmentation that assigns different sourc...

Aleix Sant, Jordi Luque, Carlos Escolano · 0 citations
#natural language process... Preprint Oct 2026

Qwen-MT-Lumen at WMT2026: Instruction-Specialized Translation via Quality-Aware Training and On-Policy Distillation

Lumen, the open-source model, achieves performance comparable to leading proprietary systems in both translation quality and translation-instruction following, and under an absolute 1--5 LLM-judge rubric that evaluates translation-instruction following and translation quality separately.

Hao Wang, Yang-Yang Liu, Xiao-Hu Zhao et al. · 0 citations

Related blog posts

Microsoft Research Blog Oct 22, 2026

Flint-interactive: A language for creating interactive data visualizations

Flint-interactive gives AI agents a language for creating interactive visualizations. Click a chart, filter data, highlight related content, and explore beyond the view the author originally chose. The post Flint-interactive: A language for creating interactive data visualizations appeared first on Microsoft Research.

MIT News · Artificial Intelligence Oct 15, 2026

AI model decodes the language cells use to communicate

A new computational approach reveals how cells communicate to assemble into tissues. This could accelerate stem cell engineering, improve disease models, and inform therapies.

Microsoft Research Blog Oct 15, 2026

Proof-based general-purpose computing with Magnetar

Zero-knowledge proofs can verify computing results without rerunning workloads or exposing sensitive data. Magnetar helps bring them into the mainstream with support for standard programming languages, major speed gains, and quantum-resistant security. The post Proof-based general-purpose computing with Magnetar appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.