Precise grounding matters. It specifies which object is the target and where that object is, even in clutter and for tiny objects, and it has to be fast enough for closed-loop control. Yet vision-language-action (VLA) and world-action models (WAMs) take perception from general-purpose vision-language and video-generati...
Generalist robot policies benefit from large-scale visual pretraining but often struggle with contact-rich dexterous manipulation, where force, compliance, and incipient slip are hard to observe from images. We present Spark-0, a spatially aligned vision-tactile-language-action (VTLA) model that uses touch in two compl...
Tian-Xing Chen, Wen-Wei Lin, Chuqiao Lyu et al.· 0 citations
Results show that making touch available does not by itself ensure effective multimodal fusion, and SoftVTBench provides a common visuo-tactile resource for studying not only whether a policy succeeds, but how it physically interacts with deformable objects and when touch improves that interaction.
Bowen Jing, Ming-Xin Wang, Ruiyang Hao et al.· 2 citations
Pretrained generative Diffusion Transformers (DiTs) capture rich pixel-level visual and language-conditioned structure through large-scale image and video generation training. A growing line of robot policies builds on this generative prior, but how it should be transferred to control remains unclear, and existing appr...
Zan-Yi Wang, Yu-Heng Lei, Deng-Yang Jiang et al.· 0 citations
Learning predictive models of contact-rich dexterous manipulation requires dense tactile interaction, but such data are costly to scale on real robots and remain tied to embodiment-specific sensors. We introduce DexTouch-WM, an action-conditioned world model that learns from scalable human touch to jointly predict futu...
Yan-Jiao Qin, Yue Chen, Wen-Wei Lin et al.· 3 citations
Precise grounding matters. It specifies which object is the target and where that object is, even in clutter and for tiny objects, and it has to be fast enough for closed-loop control. Yet vision-language-action (VLA) and world-action models (WAMs) take perception from general-purpose vision-language and video-generati...
Qi-Ze Yu, Lian-Rui Fan, Bo-Yu Chen et al.· 0 citations
MoPA is presented, a framework that aligns perceptual conditioning with mobility and manipulation while preserving coordination at the action level, and achieves state-of-the-art performance across all three task suites.
Guang-Yu Chen, Qi-Wei Liang, Shao-Long Zhu et al.· 3 citations
A reinforcement learning formulation is presented to solve in-hand assembly: mating two rigid objects within a single dexterous hand, with no second arm and no fixture, which shows robustness to state-estimation errors caused by oc- clusion.
Liu-Ao Pei, Tian-Yue Wu, Hui Zhang et al.· 3 citations
Xpolicylab is released as shared infrastructure for reproducible policy comparison and standardized deployment across simulation and physical platforms for reproducible policy comparison and standardized deployment across simulation and physical platforms.
This work proposes COMPACT-VA, a planning-aligned working memory framework built on conditional VQ-VAE, compressing extended context into bounded representations, and evaluates on high-signal dynamic scenarios where historical context is most critical for behavior correctness, and accordingly design behavioral metrics.
Zhixuan Liang, Yuxiao Chen, Yurong You et al.· arXiv.org· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.