Mean Opinion Score (MOS) is the gold standard for evaluating synthesized speech naturalness. However, current automatic MOS predictors are dominated by self-supervised learning (SSL) models that prioritize high-level semantics, potentially compromising their ability to capture critical acoustic details. In this paper,...
Tian-Yu Lan, Yu-Fei Shi, Yang Ai et al.· 0 citations
Universal audio representations must preserve acoustic detail while making high-level concepts accessible across speech, music, environmental sound, and downstream models of different capacities. We study semantic refinement of an acoustically pretrained encoder by adding audio-description alignment to a foundation of...
Le-Jun Min, Jun-Yu Dai, Rui-Chen Zheng et al.· 0 citations
Qwen-Audio-3.0-Gen-Preview is presented, a unified non-autoregressive framework that uses a Diffusion Transformer and a shared variational autoencoder (VAE) to generate the complete mixed waveform and demonstrates the potential of unified generation for temporally structured audio without task-specific branches.
Jun-Yu Dai, Xiao-Yue Duan, Xin-Yu Fan et al.· 2 citations
FullDiT is introduced, a conditional DiT that fuses eight frame-aligned RVQ streams with independently encoded captions and lyrics and uses non-causal self-attention over the complete acoustic latent sequence and outperforms five commercial systems on 15 of 18 automatic metrics.
Yun-Jia Li, Meng-Li Wu, Jun-Yu Dai et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
