LAW, a closed-loop VLM--WAM framework that unifies language reasoning, action generation, and world modeling through semantic subtask progress, is presented, establishing a new open-source state of the art on RoboTwin.
Jia-Jun Cao, Kai Tang, Bo-Hua Zhang et al.· 0 citations
As multimodal large language models (MLLMs) reason for longer, attention to the initial visual input diminishes, weakening visual grounding. Visual memory reintroduces visual evidence during reasoning. We conduct a controlled analysis of visual memory along three axes: curation, organization, and access. We find that l...
Hao-Wen Jiang, Zhan-Yu Guo, Chen-Wei Wu et al.· 0 citations
Multimodal large language models (MLLMs) have demonstrated impressive performance in multimodal understanding, but processing large numbers of visual tokens results in high computational costs. While many methods have been proposed to reduce the number of visual tokens, most of them rely on heuristics and are prone to...
Ting-Hao Wang, Yi-Chen Guo, Qi-Zhe Zhang et al.· 0 citations
WorldEcho is introduced, which probes action following over a broader action distribution using visual integrity and SE(3) trajectory alignment, and WorldSync is proposed, which strengthens action following along three complementary axes: distributional coverage, representational grounding, and intervention-effect alig...
These findings show that effective pruning should preserve broad visual coverage before fusion and progressively refine the retained tokens as cross-modal evidence evolves during fusion, and propose STAR-Pro (STage-Wise Adaptive Token Reduction with Progressive Refinement), a training-free two-stage framework.
Yi-Chen Guo, Ting-Hao Wang, Qi-Zhe Zhang et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.