When Metrics Reward the Worst Translations: Internalizing Cultural Reasoning for Social Media Translation Evaluation
A systematic empirical analysis demonstrates that standard metrics including COMET, XCOMET, and BERTScore exhibit near-zero or negative correlation with human cultural judgments, and even display a severity inversion in which scores increase as translation quality deteriorates, and proposes CuRIL, a reinforcement learn...
Yi-Wen Qiu, Linjuan Wu, Ding-Ming Li et al.
· 0 citations