Improving Cross-Lingual Token Representations by Adding a Pinch of SALT
Across five multilingual token-level benchmarks, SALT achieves the best overall results on four of them, outperforming alternative fine-tuning strategies and competitive encoders and demonstrating that span-level supervision is an effective signal for improving both token and sentence representations.
Guillem Ramírez
· 0 citations