Multimodal large language models (MLLMs) struggle with spatial, embodied, physical, and temporal reasoning. We hypothesize that these failures reflect a shared deficit in visual transition reasoning, and test whether this capability can serve as a shared training primitive, one that different models can learn from diff...
Zhe-Yu Fan, Yue Zhang, Ming-Kai Deng et al.· 0 citations
This work proposes DreamAvoid, a critical-phase test-time dreaming framework that enables VLA models to anticipate and avoid failures, and introduces an autonomous boundary learning paradigm to refine the system's understanding of the subtle boundary between success and failure.
Across unseen environments, SPA consistently and substantially improves over vanilla RL: for example, it raises the Sokoban success rate from 25.6% to 59.8% on Qwen2.5-1.5B-Instruct, letting sub-3B models surpass a 20B baseline on these tasks.
Shiqi Chen, Tong-Yao Zhu, Zian Wang et al.· 27 citations· ⚡7
WorldAgen is presented, a unified framework that jointly learns world modeling and action prediction while enabling test-time training (TTT) to adapt to new environments, and surpasses existing state-of-the-art models at inference time.
Chi Wan, Kang-Rui Wang, Yuan Si et al.· AAAI Conference on Artificia...· 5 citations
This work introduces HumanCLAW, an evaluation framework that decouples action decision-making from low-level execution in a vision-language model (VLM), and builds HumanCLAW-Bench, a database of 1,218 long-horizon, egocentric find-navigate-interact episodes across 41 indoor scenes.
Foundation-model policies for robotic manipulation are advancing rapidly on task success, but rigorous evaluation of whether they succeed safely is still lacking. We introduce ManiGuard, a specification-grounded framework for evaluating and improving the safety of foundation-model manipulation, comprising the ManiGuard...
Yi Peng, Philip Wang, Simon Sinong Zhan et al.· 2 citations· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.