English is Not All You Need: Systematically Exploring the Role of Multilinguality in LLM Post-Training
A systematic, controlled study of the interplay between training language coverage, model scale, and task domain, based on 220 supervised fine-tuning runs on parallel translated multilingual data mixtures spanning mathematical reasoning and API calling tasks, finds that English-only post-training is typically suboptima...