Transcribing music into a human-readable score requires a coherent understanding of rhythm, harmony, melody, and form. Two obstacles limit this goal: annotated recordings are scarce, and accurate local predictions can still produce inconsistent musical sequences. We present SheetSage2, a unified music transcription fra...
Jun-Yan Jiang, Rui-Bin Yuan, Jia-Hao Pan et al.· 1 citation· ⚡1
This work introduces \rig (Reciprocally Interactive Generation), a framework for reciprocal interaction in generative gameplay that combines persistent state and configurable rules, contextual interaction reasoning, and action-conditioned audiovisual generation.
Meng-Fei Li, Yi Zhang, Xingtong Ge et al.· 0 citations
World simulation is inherently multisensory, demanding synchronized visual and acoustic dynamics in real time. Yet prevailing interactive world models remain strictly silent, focusing exclusively on visual rendering and control while overlooking the acoustic dimension. We present HelixWorld, a real-time interactive aud...
Lei Ke, Jia-Hao Pan, Ze-Yue Tian et al.· arXiv.org· 1 citation
EmotiStage, an emotion-driven performance system powered by multi-modal generative AI that supports emotional awareness by enabling users to externalize, observe, and reinterpret emotions through music and stage performance, is presented.
Zi-Ying Wang, Yi-Hong Lin, Xiang-Lin Zhao et al.· Proceedings of the 28th Inte...· 0 citations
EmotiStage, an emotion-driven performance system powered by multi-modal generative AI that supports emotional awareness by enabling users to externalize, observe, and reinterpret emotions through music and stage performance, is presented.
Zi-Ying Wang, Yi-Hong Lin, Xiang-Lin Zhao et al.· Proceedings of the 28th Inte...· 0 citations
Symbolic models make melody, harmony, rhythm, and form explicit but typically stop before a finished recording; audio models produce complete songs while leaving composition implicit. We introduce YuE2, which unifies symbolic and audio music generation at frontier quality through symbolic planning. A single AR-NAR Mixt...
This work proposes MemCoRe, which organizes memory as a compression hierarchy where each level compresses redundancy further while retaining the structure needed for retrieval at that level, and demonstrates that MemCoRe outperforms existing state-of-the-art baselines.
Zhenyuan Zhang, X. Jia, Zhiqin Yang et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.