SAIL is proposed, a Spatial Audio Intelligence framework with LLMs that preserves acoustic-spatial structure and source-level correspondence from audio encoding to LLM alignment and achieves consistent improvements in dual-source sound event detection, direction and distance estimation, and spatial reasoning.
Zheng-Ding Luo, Jin-Yang Wu, Hao-Zhe Ma et al.· 1 citation
This work advances SPI research from static images to dynamic videos and ensures more comprehensive scenario coverage during benchmarking with RobotEQ-Video, a hierarchical world-state taxonomy organized into a four-level coarse-to-fine structure.
Xin-Yi Che, Zheng Lian, Kuo-Fei Fang et al.· 2 citations
This work introduces VideoGAIA, an agentic video understanding benchmark for general artificial intelligence (AI) assistants, and formulates video understanding as a multi-turn, tool-augmented interaction process, where models must iteratively perceive videos, invoke external tools, gather complementary information, an...
Fan Zhang, Guang-Ming Yao, Jin-Yang Wu et al.· 1 citation
This work aims to advance the development of socially desirable embodied agents in open-domain environments by extending the concept of proactive assistance to Social Proactive Intelligence (SPI), characterized by diverse scenarios, social understanding, and robot-centric behaviors.
Kuo-Fei Fang, Zheng Lian, Xin-Yi Che et al.· 3 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
