SAIL is proposed, a Spatial Audio Intelligence framework with LLMs that preserves acoustic-spatial structure and source-level correspondence from audio encoding to LLM alignment and achieves consistent improvements in dual-source sound event detection, direction and distance estimation, and spatial reasoning.
Zheng-Ding Luo, Jin-Yang Wu, Hao-Zhe Ma et al.· 0 citations
A hierarchical clustering algorithm is applied to analyse whether prepared speaker embeddings naturally form clusters with hierarchical relationships, and a new method is proposed, termed Hierarchical Cluster-Class Matching (HCCM), to identify which hierarchical clusters best match individual semantic classes like male...
Yanze Xu, Wen-Wu Wang, Mark D. Plumbley· 0 citations
This work proposes FlowSep2, a text-conditioned flow-matching generative model for LASS, which learns to generate the target source representation from Gaussian noise in a latent space, conditioned on both the mixture representation and the text query.
Yiitan Yuan, Xu-Bo Liu, Haohe Liu et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.