Gander is presented, a native multimodal duplex interaction model that builds on MiniCPM-o 4.5 and is further adapted for realtime interaction with an asynchronous agent loop and is released together with its models, code, and data to facilitate further research and development in the community.
Orantqing, Shengpeng Ji, Jun-Long Tong et al.· 3 citations
SwanWeave is presented, the first one-stage multi-task framework for instruction-guided 3D FOA spatial audio editing, and introduces Spatial Preference Optimization (SPO), a Direct Preference Optimization (DPO)-based alignment objective with edit-specific negative targets, and adopts staged training to improve natural-...
Ke Lei, Chenyuhao Wen, Yu Zhang et al.· 1 citation· ⚡1
SwanTale is proposed, a multi-speaker expressive speech and audio generation model that supports both zero-shot and instruct tasks, and adopts reward-conditioned quality control and Engram conditioning along with Unified MoE for multi-task and multi-audio-modality modeling.
Yu Zhang, Ruiqi Li, Changhao Pan et al.· 3 citations
Spatial-Omni is a lightweight method that implements SO-Encoder to inject First-Order Ambisonics (FOA) spatial audio into existing Omni LLMs as an independent modality, without modifying their original audio encoders.
Vocalized audio synthesis, the task of generating audio in which intelligible speech is embedded within an environmental soundscape, underpins applications such as podcast production and video dubbing, and VoxAudio, a causal autoregressive flow matching model that addresses this problem from three complementary aspects...
Wenxiang Guo, Changhao Pan, Ziyue Jiang et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.