Multimodal large language models (MLLMs) struggle with spatial, embodied, physical, and temporal reasoning. We hypothesize that these failures reflect a shared deficit in visual transition reasoning, and test whether this capability can serve as a shared training primitive, one that different models can learn from diff...
Zhe-Yu Fan, Yue Zhang, Ming-Kai Deng et al.· 0 citations
Across unseen environments, SPA consistently and substantially improves over vanilla RL: for example, it raises the Sokoban success rate from 25.6% to 59.8% on Qwen2.5-1.5B-Instruct, letting sub-3B models surpass a 20B baseline on these tasks.
Shiqi Chen, Tong-Yao Zhu, Zian Wang et al.· 27 citations· ⚡7
WorldAgen is presented, a unified framework that jointly learns world modeling and action prediction while enabling test-time training (TTT) to adapt to new environments, and surpasses existing state-of-the-art models at inference time.
Chi Wan, Kang-Rui Wang, Yuan Si et al.· AAAI Conference on Artificia...· 5 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.