Reinforcement Learning-Based Interactive Control of an Omnidirectional Mobile Lower Limb Rehabilitation Robot

Abstract

This paper proposes a hierarchical control architecture that is established at both lower limb joint and platform levels based on a simplified admittance model, where compliance is regulated through virtual mass and damping. At the lower limb joint level, admittance control governs lower limb motion tracking, while at the platform level it adjusts the omnidirectional mobile platform velocity in response to human interaction forces. Within this framework, a Sarsa-based reinforcement learning agent dynamically optimizes the parameters of a Sigmoid function using dual state inputs. Based on hip joint angle error and human–robot interaction force, the controller dynamically adjusts virtual mass and damping to optimize the trade-off between tracking error and dynamic compliance. The simulation and experimental results on the prototype system demonstrate that, compared with traditional Sigmoid parameter-tuned admittance control, the proposed approach significantly enhances gait smoothness (dimensionless squared jerk reduced by 65.62% and 36.74% for hip and knee joints), and increases human–robot interaction compliance (RMS interaction force was reduced from 3.2502 N to 2.5109 N; EPUD decreased from 12.14 to 9.53). Moreover, the proposed strategy achieves smaller maximum overshoot (0.45° vs. 0.9°) and faster settling time (2.6 s vs. 4.59 s). These findings indicate that integrating reinforcement learning with Sigmoid parameter adaptation provides a systematic and effective solution for adaptive compliance regulation in mobile exoskeleton systems, enhancing adaptability, safety, and functional relevance for stroke patients undergoing lower limb rehabilitation training.