Quantifying the Generation Modality Gap in Speech-Text Language Models
The speech-text model closes much of the scaling gap in transcript-based semantic coherence, suggesting that text provides an efficient semantic training signal for spoken language modeling.
Ju-Chieh Chou, Jia-Wei Zhou, Karen Livescu
· 0 citations