BEHAVIOR-Spatial is presented, a benchmark built on BEHAVIOR-1K that measures spatial question answering, point-based target grounding, and robot action to examine how VLM spatial understanding relates to VLA behavior.
Sirui Chen, Huang Huang, Qineng Wang et al.· 2 citations· ⚡1
Vision-language-action (VLA) policies trained on large datasets are capable within their training domains, yet they still fail to generalize to the variety of situations a robot meets in real-world deployment. Agentic robot systems complement the policy with a vision-language model (VLM) orchestrator that learns when t...
Xi-Lun Zhang, M. Wang, Erik Bauer et al.· 1 citation· ⚡1
T2-Z is introduced for test-time optimization of environment latents, which augments a robotic world model with a learnable environment latent to condition world predictions, and can efficiently infer environment latents from as little as a single test-time interaction trajectory.
Chen-Yuan Zhou, Yi-Ning Hong, Huang Huang et al.· 0 citations
Memory-dependent robotic manipulation requires policies to use information that is no longer available in the current observation. Retaining history alone is insufficient: memory must preserve information that supports future actions. One challenge is whether a memory-free foundation model can learn to retain and use h...
Yi-Ze Liu, Huang Huang, Yi-Ning Hong et al.· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.