Audio-video generation using heterogeneous multimodal references has emerged as a new challenge, requiring both compositional control over generation and grounded understanding of multimodal context. In this paper, we introduce ORAV Bench for Omni Reference Audio-Video Generation, comprising 380 task instances with 2-1...
Jia-Cheng Hua, Xiao-Kun Feng, Jia-Qi Hua et al.· 0 citations
This framework minimizes maximum mean discrepancy in frozen self-supervised video representation spaces in frozen self-supervised video representation spaces, using a hybrid Nystr\"om--Monte Carlo estimator to balance approximation bias and sampling variance.
Chi Zhang, Yue-Yi Liu, Hao-Yan Shi et al.· 1 citation
InteracVid is introduced, the first open-source large-scale dataset that addresses this missing supervision, so that every sample couples a preceding audio-visual context and an external stimulus with the realinteractive response that follows.
Chi Zhang, Hao-Yan Shi, Yue-Yi Liu et al.· 2 citations
PIVOTS is introduced, the first benchmark built from Social-IQ 2.0 and YouTube data to evaluate MLLMs'ability to predict bidirectional interpersonal relationship dimensions grounded in established psychology research and examines how joint and pairwise prediction settings benefit MLLMs in scoring bidirectional PIVOTS d...
Shuxiang Zhang, Yiting Yin, Wen-Xuan Song et al.· arXiv.org· 0 citations
This work introduces MeetingToM, a benchmark for complex social behavior reasoning in naturalistic multi-party meetings and establishes MeetingToM as a testbed for advancing meeting-grounded ToM in multimodal models.
This paper proposes ElasticTTT, a novel framework that preserves the prior generative distribution and rescues generative elasticity in standard TTT, achieving state-of-the-art performance on one-shot video editing.
Yueyi Liu, Chi Zhang, Sen Cui et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
