Generative speech enhancement models can produce cleaner and more natural-sounding speech than conventional discriminative approaches, but may hallucinate by changing speech content or speaker identity, even with transcript conditioning. We present AuraSE, a flow-matching framework that addresses hallucination through...
Ying Shen, Yao Qian, Yuxuan Hu et al.· 0 citations
AutoSynth, which represents MIDI performance events, fixed synthesizer parameters, and variable-length modulation routes as a unified sequence for a synthesizer, and learns their dependencies with an audio-conditioned autoregressive model, is presented.
Tristan Wu, Daniel Chin, Li-Wei Lin et al.· 0 citations
Voice agents are converging on a collaboration pattern: a full-duplex interaction model stays on the live channel as the entry to the conversation, while search, reasoning, and coding are handled through asynchronous delegation. A duplex model supports continuous listening and speaking, but complex reasoning and tool u...
Ying Shen, Yu-Xiang Wang, Kun-Yu Feng et al.· 0 citations
Decoupled-Live-ProsodyJudge (D-LPJ), a cost-effective pairwise evaluator distilled from Gemini into Qwen3-Omni, and a novel span-local GRPO strategy that applies normalized advantages strictly to their corresponding rationale spans.
Zi-Fan Guan, Long-Yu Lu, Ju-Nan Zhang et al.· 0 citations
Prompt-conditioned piano MIDI-to-Music rendering aims to faithfully render target notes while reproducing the timbre of a reference recording. Existing approaches primarily follow two paradigms: autoregressive (AR) modeling and flow matching (or diffusion). Discrete-codec AR models provide causal temporal modeling, but...
Experiments on Dexed show that, after supervised training, the discrete diffusion model is competitive with autoregressive and flow-matching baselines, and reward-based fine-tuning further improves out-of-domain audio matching performance.
Tristan Wu, Daniel Chin, Ju-Nan Zhang et al.· 1 citation· ⚡1
MIDI-to-Music system renders the melody and rhythm of a target MIDI sequence into musical segment while cloning instrument timbre from a prompt recording. Existing systems typically adopt one of two distinct paradigms: conditional generation with prompt audio alone, which remains applicable when aligned prompt MIDI is...
Chong Jing, Junan Zhang, Jing Yang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
