This work presents the principled integration of the two expert‐defined domains of robotic care as a two‐level expert defined optimization scheme which incorporates control with physics modelling of the system and environment at the lower level, and classical planning with complex task logic at the higher level, integrated with a capacity for learning.
Abstract
Research, innovation and practical capital investment have been increasing rapidly toward the realization of autonomous physical agents. This includes industrial and service robots, unmanned aerial vehicles, embedded control devices, and a number of other realizations of cybernetic/mechatronic implementations of intelligent autonomous devices. In this paper, we consider a stylized version of robotic care, which would normally involve a two‐level Reinforcement Learning procedure that trains a policy for both lower level physical movement decisions as well as higher level conceptual tasks and their sub‐components. In order to deliver greater safety and reliability in the system, we present the general formulation of this as a two‐level expert defined optimization scheme which incorporates control with physics modelling of the system and environment at the lower level, and classical planning with complex task logic at the higher level, integrated with a capacity for learning. This synergistic integration of multiple methodologies—control, classical planning, and RL—presents an opportunity for greater insight for algorithm development, leading to more efficient and reliable performance. Here, the notion of reliability pertains to physical safety and interpretability into an otherwise black box operation of autonomous agents, concerning users and regulators. This work presents the principled integration of the two expert‐defined domains. The methodology is validated in a simulation of robotic care aid, with complex medication and meal preparation tasks at the upper level and locomotion at the lower level. The validation confirms the framework's adaptability to human preferences and symbolic to continuous feedback.
Introduction Autonomous robotic manipulation in modern manufacturing requires control policies that simultaneously achieve precision, adaptation, operational safety, and multi-task capability. Methods This paper proposes a Transformer-Based Reinforcement Learning Network (TRL-Net) that combines temporal state encoding,...
Balnur Kenjayeva, A. Galimov· Frontiers in Artificial Inte...· 0 citations
Robotics is advancing toward embodied intelligence and high-level autonomy, requiring the seamless integration of sensing, computation, communication, control, and human interaction to be designed as a coherent system. This Editorial synthesizes ten contributions to this Special Issue, entitled “Advanced Intelligent Ro...
Tamás Haidegger, Levente Kovács, Péter Galambos· Italian National Conference...· 0 citations
A comprehensive review of published RL-based control studies using the Quanser Aero, Aero 2, 3-DOF Helicopter, and Autonomous Vehicles Research Studio (AVRS) platforms identifies standardised evaluation procedures, reproducible reporting, safety-aware RL, interoperable software interfaces, and higher-fidelity digital t...
Ghulam E. Mustafa Abro, S. Memon, Jawad Tanveer· Electronics· 0 citations
A control-oriented review of RL-based quadrupedal robot control, which introduces the main physical and algorithmic foundations, and examines recent research progress from three complementary aspects: control architecture, observation and information design, and training task formulation.
Chen Chang· Proceedings of the 3rd Inter...· 0 citations
Feature-fusion Multi-Agent Proximal Policy Optimization (FMAPPO) is proposed, which fuses 2D LiDAR measurements with task-specific state information to enable safe decentralized multi-robot task assignment and navigation and demonstrates that the learned decentralized policies can coordinate multiple robots to service...
A. Abdalwhab, Giovanni Beltrame, David St-Onge· arXiv.org· 0 citations
This survey charts the spectrum from model-driven control to embodied intelligence, and organizes model-driven control into physics-based, data-driven, and hybrid paradigms, providing a unified lens for synthesizing and comparing these three classes of control strategies.