Polyglot Teachers: Evaluating Language Models for Multilingual Synthetic Data Generation
This work systematically characterize what makes an effective multilingual teacher, and combines intrinsic measures of data quality with extrinsic student model performance in a metric the authors call Polyglot Score, which reveals that model scale alone does not significantly predict teacher effectiveness.