Aligned and realistic latent diffusion for text-to-motion generation

Abstract

Text-to-motion generation aims to synthesize semantically consistent and naturally coherent motion sequences from natural language descriptions. Given the continuous nature of human motion, diffusion models operating in a continuous latent space offer inherent advantages over vector quantization-based methods, particularly in avoiding quantization errors and in modeling quality. However, existing diffusion models primarily rely on mean squared error loss. This stepwise regression paradigm often leads to ‘over-smoothed’ motion sequences and struggles to capture the subtle semantic nuances embedded in textual descriptions. To realize the potential for continuous diffusion generation, an enhanced latent-space diffusion framework designed to elevate generation capabilities across two dimensions, namely, distribution approximation and semantic alignment, is proposed. Specifically, a latent-space adversarial discriminator is incorporated. By applying decoupled adversarial supervision, this component mitigates the detail loss caused by mean regression, significantly enhancing the physical realism and dynamic sharpness. Concurrently, a latent-space contrastive alignment strategy is introduced during the denoising process that reinforces the correspondence of the generated motion sequences with the given textual inputs via explicit cross-modal constraints. Extensive experiments on standard benchmarks demonstrate that the proposed method effectively addresses the limitations of conventional diffusion models, thus validating the potential of continuous diffusion frameworks within the domain of text-driven motion synthesis.