Xin-Song Feng

Rethinking the Roles of Diffusion and Decoding: Predictive-State Flows for Parallel Language Generation

In continuous diffusion language models (DLMs), latents generated by the diffusion prior are mapped almost deterministically to tokens, either by a decoder or through a token embedding matrix. Unlike in image generation, where visual details can vary continuously, the diffusion prior must capture fine-grained discrete...