Multimodal large language models have become the dominant paradigm for visual understanding, but incur substantial costs by encoding inputs into dense, fixed-size patch tokens. However, visual information is unevenly distributed: some regions require fine-grained detail, while others admit compact representations. Down...
Yuan Feng, Qi-Ze Yang, Rui-Zhe Chen et al.· 0 citations
Scaling Multimodal Large Language Models (MLLMs) to long-form video understanding is bottlenecked by the explosion of visual tokens, which saturates context windows and incurs prohibitive costs. Current solutions predominantly rely on auxiliary models for token reduction but face a fundamental dilemma: lightweight enco...
Hao-Yu Guo, Yuan Feng, Junlin Lv et al.· 1 citation
LibraSpec, a training-free and plug-and-play algorithm that iteratively determines the speculative length using drafter confidence scores, is developed and it is proved that LibraSpec monotonically converges toward the optimal speculative length.
Zexun Lin, Yuan Feng, Junlin Lv et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.