Findings of the WMT26 Multilingual Instruction Shared Task: Small Models Are Not Yet Polyglots
Patrícia Schmidtová, Katia Artemova, Seth Aycock et al.
· 0 citations
3 papers indexed here
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
Calibrating LLM Judges for Human and AI Conversations
This work evaluates state-of-the-art LLMs as pointwise and pairwise judges of conversational success on CANDOR, finding pointwise scoring correlates moderately with human ratings, while pairwise comparison suffers from long transcripts and positional bias.
Maike Zufle, Patrícia Schmidtová, Vilém Zouhar et al.
· 0 citations
#natural language process...
May 2026
Why We Need Speech to Evaluate Speech Translation
It is argued that progress requires dedicated speech-specific training data and models that genuinely condition on speech, and both text- and speech-based quality estimation metrics on two contrastive datasets targeting gender agreement and prosody fall short.
Maike Zufle, Danni Liu, Vilém Zouhar et al.
· arXiv.org · 1 citation