Feeding BabyLMs Macaroni: Code-Switching Curricula Cause Cross-Lingual Convergence
It is found that training on code-switched data aligns the representations of parallel text, particularly across different scripts, and that this alignment persists through training on monolingual documents.
Dries Rooryck, Alex Cai, Yonatan Belinkov et al.
· 0 citations