AURORA-LM: Autoencoding Unified Representation for Continuous-Latent Diffusion Language Modeling
AURORA-LM is introduced, a continuous-latent diffusion language model that separates the construction of a decodable text representation from the modeling of its distribution, and achieves the strongest performance among evaluated continuous and diffusion-based language models on OpenWebText free generation and XSum su...