Nicolas M. Dahan

MetaDocEval: A Contrastive Framework for Evaluating Machine Translation Metrics at the Document-Level

TermJudge: A Document-Level Metric Judging, Not Counting, Terminology in Machine Translation Evaluation

Existing automatic metrics for evaluating terminological use in machine translation (MT) penalise any divergence from a fixed reference, conflating translation errors with the valid terminological variation that human translators routinely produce. We introduce TermJudge, a document-level terminology metric that assign...

Improving Term Evaluation in Machine Translation: Variation Matters

It is argued for variation-aware evaluation that conditions consistency penalties on whether target-side variation mirrors source-side variation, and constraining MT with a glossary improves accuracy and consistency but degrades CTV by suppressing valid variation.