Skip to content
#robotics Preprint

ORPA: Online Residual Policy Adaptation for Robot Manipulation Control with Human Feedback

Aug 2026 · 0 citations · 21 references
Computer Science

Abstract

Robotic manipulation policies trained via imitation learning, such as Action Chunking with Transformers (ACT), can achieve strong performance under ideal conditions but often remain sensitive to small execution errors and distribution shifts. Correcting these failures typically requires dataset aggregation and full-policy retraining, which is computationally expensive and unsuitable for real-time deployment. In this work, we propose Online Residual Policy Adaptation (ORPA), a framework that enables immediate, feedback-driven correction of robot actions without modifying the underlying policy parameters. ORPA augments a pretrained control policy with a lightweight, feedback-conditioned module that predicts residual adjustments directly in joint space, allowing the system to adapt its behavior at runtime. We evaluate ORPA on a set of precision-sensitive manipulation tasks using the ALOHA platform, demonstrating improvements in success rate and recovery from small perturbations compared to baseline control policies and rule-based inverse kinematics corrections.

View source

Similar papers

#artificial intelligence Review Apr 2023

Transformer-Based Autonomous Driving Models and Deployment-Oriented Compression: A Survey

This survey reviews representative Transformer-based autonomous driving models and organizes them by task role, sensing configuration, and architectural design and analyzes how efficiency constraints reshaping model design choices in practice affects deployability, robustness, and safety.

J. Zhong, Zheng Liu, Xiangshan Chen · 21 citations

IntentVLA: Short-Horizon Intent Modeling for Aliased Robot Manipulation

IntentVLA is introduced, a history-conditioned VLA framework that encodes recent visual observations into a compact short-horizon intent representation and uses it to condition chunk generation and improves rollout stability and outperforms strong VLA baselines.

Shijie Lian, Bin Yu, Xiaopeng Lin et al. · 6 citations

FlowCorrect: Efficient Interactive Correction of Generative Flow Policies for Robotic Manipulation

The results clearly demonstrate that FlowCorrect learns from very few demonstrations and enables fast, sample-efficient, incremental, human-in-the-loop corrections of generative visuomotor policies at deployment time in real-world robotics.

Edgar Welte, Yitian Shi, R. Wolf et al. · 4 citations
#computer vision Jun 2026

RoboTrustBench: Benchmarking the Trustworthiness of Video World Models for Robotic Manipulation

It is found that current models often generate visually coherent videos, but struggle with constraint reasoning, counterfactual grounding, physical interaction, and unsafe-instruction suppression, and results show that visual quality and surface-level instruction following are insufficient for trustworthy robotic video world modeling.

Huiqiong Li, Jia-Yu Wang, Zhiting Mei et al. · 4 citations
#artificial intelligence Conference Sep 2025

Spatial-Semantic Reasoning using Large Language Models for Efficient UAV Search Operations

A real-time semantic navigation framework for Unmanned Aerial Vehicles (UAVs) focused on improving time efficiency in the Object Goal Navigation (ObjectNav) task, using a Large Language Model that interprets user-provided natural language instructions and performs semantic reasoning over detected objects and spatial context to prioritize high-probability search regions.

Marin Maletic, Marijana Peti, T. Petrović et al. · 3 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.