SimpleMemVLA, a VLA without a dedicated memory module that uses the backbone's native video context directly as memory, achieves state-of-the-art results on four memory benchmarks without loss on general-purpose control, and with the same backbone and training setup it outperforms retrieval, compression and recurrent-s...
C. Yin, Wang Xu, Jun-Peng Yang et al.· 2 citations
This paper proposes a transferable Map of Dynamics (MoD) framework that generalizes to unknown environments using only egocentric 3D LiDAR point clouds to overcome the long-standing limitation of traditional MoD methods. While MoDs are essential for encoding human motion characteristics to enable accurate pedestrian tr...
Azusa Sawada, Allan Wang, Hideo Saito et al.· 0 citations
Physical human-robot collaboration requires a robot to provide assistance when human intention is clear while remaining compliant when several future motions are plausible. We present an adaptive stiffness framework based on generative action-chunk sampling. Conditioned on an RGB image and external joint-torque estimat...
Aoi Otake, Ferdinand Hartmann, Ko Igari et al.· 0 citations
Multi-fingered robots promise the speed and dexterity of human hands, yet challenging problems such as precise assembly have remained out of reach. These tasks are contact-rich, making data collection for imitation learning difficult, and sparse-reward, making direct exploration with reinforcement learning (RL) intract...
Tyler Ga Wei Lum, Kushal Kedia, C. Karen Liu et al.· 0 citations
Reach audiences
Advertise in front of researchers, engineers, and readers.
Hierarchical vision-language-action (Hi-VLA) systems have emerged as a promising paradigm for complex robot manipulation, by using high-level VLM planners to decompose tasks into language subgoals executed by low-level VLA controllers. Despite recent empirical progress, there is a lack of unified design principles for...
Jiaheng Hu, Mohit Shridhar, Caden Lu et al.· 0 citations
A policy tuned for one robot often behaves differently on another, whether due to the sim-to-real gap, unknown payloads, or the differing dynamics of two instances of the same robot. In contact-rich, dynamic manipulation, even small motion discrepancies can result in failure to track reference motion, since they disrup...
Dongwon Son, Florian Shkurti, Jason Lee et al.· 0 citations
HeteroGenManip is proposed, a task-conditioned, two-stage framework designed to decouple initial grasp from complex interaction execution, and achieves robust intra-category shape and pose generalization.
This work proposes AtomicVLA, a unified planning-and-execution framework that jointly generates task-level plans, atomic skill abstractions, and fine-grained actions, and introduces a flexible routing encoder that automatically assigns dedicated atomic experts to new skills, enabling continual learning.
Likui Zhang, Tao Tang, Zhihao Zhan et al.· arXiv.org· 19 citations· ⚡3
A deep AIF framework that integrates a diffusion policy as the policy model and a multiple timescale recurrent state-space model (MTRSSM) as the world model is proposed, demonstrating how AIF based on EFE minimization can unify exploration and goal-directed navigation in real-world robotic settings.
Riko Yokozawa, Kentaro Fujii, Yuta Nomura et al.· arXiv.org· 1 citation
Q-SVMPC is proposed, a Q-guided Stein variational MPC method with an RL-informed policy prior, which casts learning-based MPC as trajectory-level posterior inference and refines trajectory particles via SVGD under learned soft Q-value guidance to explicitly preserve diverse solutions.
Shizhe Cai, Zeya Yin, Jayadeep Jacob et al.· 3 citations
We study the problem of navigating cluttered indoor environments with a humanoid robot. Unlike conventional methods that model navigation as a 2D path planning problem, humanoid traversal in cluttered environments requires continuous geometry-aware whole-body adaptation, including coordinated arm placement, torso adjus...
A. Li, Yu-Xin Chen, Zhao-Bo Li et al.· 2 citations
DeCAL is presented, a physically-grounded dexterous vision-language-action model that unifies understanding, imagination and action generation for contact-rich dexterous manipulation and introduces Adaptive Visuo-Tactile Fusion that dynamically regulates tactile interactions via a contact-aware gating strategy.
Yan-Kai Fu, Ning Chen, Jun-Kai Zhao et al.· 0 citations
Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.
Gemini Robotics ER 2 helps robots reason, collaborate, and solve real-world tasks. It represents a step change in video understanding, tool orchestration, and multi-robot collaboration for robotic applications.
From feet to fingertips — we are teaching robots intelligent whole-body control, fine dexterity, and teamwork to complete a broad range of complex tasks.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.