An end-to-end learned proprioceptive odometry estimator for legged robots under unreliable contact conditions that directly predicts relative displacement, relative rotation, and body-frame velocity from a recent history of onboard inertial and joint measurements.
Abstract
In this paper, we present TRACE (Tokenized Robust Attention for Contact-Aware Estimation), an end-to-end learned proprioceptive odometry estimator for legged robots under unreliable contact conditions. The proposed estimator directly predicts relative displacement, relative rotation, and body-frame velocity from a recent history of onboard inertial and joint measurements. To improve robustness under unreliable contact conditions, we introduce a foot-aware cross-attention module that adaptively weights IMU and leg-wise kinematic tokens without relying on manually defined contact or slip thresholds. The estimator is trained with direct supervision and two physics-inspired auxiliary losses that promote kinematic consistency and reliable use of leg information. To reduce policy-specific overfitting and consequently improve sim-to-real transfer, simulation training incorporates policy randomization, followed by partial real-world fine-tuning of the temporal encoder and prediction head. Experiments across diverse indoor and outdoor terrains demonstrate consistent reductions in position drift compared with classical filtering-based, hybrid, and purely learning-based baselines. Ablation studies further validate the contributions of the proposed training objectives, policy randomization, and real-world fine-tuning, particularly under unreliable contacts and sim-to-real mismatch.
Foot forward kinematics (FK) is widely used to improve proprioceptive legged odometry by providing reliable velocity constraints during foot support. Existing contact-aided estimators generally rely on binary contact decisions to determine whether the FK measurements of an entire foot should be trusted. However, contac...
Kaixin Feng, Ang Li, Shaoxiong Zhang et al.· 0 citations
Proprioception-only locomotion over complex terrain is essential for quadruped robots when external perception is unavailable or unreliable. Existing methods either rely on privileged physical quantities for supervision or infer environmental information from short-term state evolution, which may lead to overemphasis o...
Kaicen Li, Lingyu Yin, Mengyang Li et al.· IEEE Access· 0 citations
PACE (Proprioception-Anchored Cross-Modal Encoder) is presented, which supervises temporal visual and F/T representations by predicting proprioceptive state transitions and is robust to perturbations that substantially degrade pose-based and learned-fusion baselines.
Yu-Han Wang, Yurou Chen, Hong-Ye Jiang et al.· 0 citations
Prior-Informed Odometry from Human-Motion Tracking (PRIMO) generates odometry supervision by having the humanoid track diverse retargeted human motions in simulation, decoupling supervision from the deployment policies and broadening the training motion distribution, and consistently lowers mean trajectory errors relat...
Xuan-Wen Han, Ang Li, Shaoxiong Zhang et al.· 0 citations
Reliable state estimation on low-cost quadruped robots is hindered by sensor noise, mechanical backlash, and structural compliance. Current methods face distinct limitations: the reliance on precise contact sensors in pure kinematics, training-coverage dependence in end-to-end networks, and sub-optimal mode averaging i...
Zuo-Wei Chen, Yu-Dong Liu, Hao Wen et al.· IEEE Robotics and Automation...· 0 citations
Industrial inspection often involves safety risks, making legged robots highly suitable for replacing human labor. However, robust locomotion across diverse, unstructured terrains remains challenging due to estimation uncertainties. In this work, we propose a proprioceptive reinforcement learning (RL)-based locomotion...