J. Pierrehumbert

Prosodic Structure as a Critical Component in Phonemic Language Modelling at BabyLM Scale

Human children learn language from continuous, prosodically structured speech long before they can read, yet almost all language models train on orthographic text. Building on previous phonemic BabyLM training (Goriely et al., 2024; arXiv:2410.22906), we ask whether supplying an estimate of the prosody infants exploit...