Existing approaches for robot learning in simulation often require substantial manual effort to construct scenes and specify tasks, limiting training scalability and data diversity. Meanwhile, in-the-wild robot demonstrations naturally provide diverse and realistic observations of real-world interactions. Leveraging th...
Tian-Ling Xu, Wei-Jie Wan, Hong-Hao Su et al.· 0 citations
Generalist robot policies benefit from large-scale visual pretraining but often struggle with contact-rich dexterous manipulation, where force, compliance, and incipient slip are hard to observe from images. We present Spark-0, a spatially aligned vision-tactile-language-action (VTLA) model that uses touch in two compl...
Tian-Xing Chen, Wen-Wei Lin, Chuqiao Lyu et al.· 0 citations
Embodied AI systems are often organized into System 1 and System 2. System 1 is typically a pretrained policy that generates actions at high frequency, whereas System 2 is often instantiated as a vision-enabled language model for high-level planning. We ask whether a large language model (LLM) can act as the policy for...
Learning predictive models of contact-rich dexterous manipulation requires dense tactile interaction, but such data are costly to scale on real robots and remain tied to embodiment-specific sensors. We introduce DexTouch-WM, an action-conditioned world model that learns from scalable human touch to jointly predict futu...
Yan-Jiao Qin, Yue Chen, Wen-Wei Lin et al.· 3 citations
This work pretrain MM-ABC, a foundation model built around Seeing, Coordinating, and Imagining Arm-Base Collaboration, which combines sparse multi-level VLM features for spatial perception; a training-only future branch that uses world imagination and geometric intent as extra supervision, strengthening perception and...
Qi-Wei Liang, Guang-Yu Chen, Shao-Long Zhu et al.· 0 citations
MoPA is presented, a framework that aligns perceptual conditioning with mobility and manipulation while preserving coordination at the action level, and achieves state-of-the-art performance across all three task suites.
Guang-Yu Chen, Qi-Wei Liang, Shao-Long Zhu et al.· 3 citations
This work presents TouchSight, a monocular egocentric vision framework for dense full-hand contact force prediction that leverages 500 hours of pressure-glove recordings and extensive hand-object interaction (HOI) data and demonstrates that dense tactile signals can be recovered from egocentric vision alone, without ta...
Dan-Yan Zhou, Jin-Xuan Lu, Jia-Wei Lin et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.