Visual token pruning for multimodal large language models (MLLMs) appears highly effective, with existing methods retaining over 95% of unpruned performance on common VQA benchmarks using a quarter of the visual tokens or fewer. However, our extensive evaluation of ten methods across three MLLM families and five abilit...
Pei-Ran Yin, Hao Wu, Zi-Hao Yang et al.· 1 citation
Video editing models achieve strong performance in modifying appearance, backgrounds, styles, and motions, empowered by large-scale training data. Beyond general scenarios, professional motions are significant in performance, sports, and martial arts. This paper focuses on professional motion editing, which involves fi...
Si-Yi Qian, Han-Qing Yang, Wei-Huang Lin et al.· 0 citations
This work takes the other half of the classical transform-coding toolkit instead: keep every token and vary its rate, and preserves the model's output distribution and its answers better than uniform-rate coding, the closed-form water-fill and distortion-ranked pruning.
Hong-Bo Zhang, Zi-Hao Yang, Liu-Yang Song et al.· 0 citations
A three-stage pipeline that converts human motion-capture recordings into dexterous robot policies with no real-robot training data is built, which transfers one human dataset to four morphologically distinct robot hands, and executes four contact-rich bimanual tasks on physical hardware with zero real-robot training d...