Jul 2026· 2026 23rd International Conference on Ubiquitous Robots (UR)· pp. 343-346· 0 citations· 24 references
Computer Science
Abstract
As Vision-Language-Action (VLA) models continue to scale in the number of parameters, the computational cost and resource requirements for domain-specific fine-tuning have become significant barriers to practical robotic deployment. While Parameter-Efficient Fine-Tuning (PEFT) techniques like LoRA (Low-Rank Adaptation) offer a potential solution, they often fail to match the task success rates of their fully fine-tuned counterparts. In this paper, we propose a novel hierarchical VLA architecture that achieves state-of-the-art performance while maintaining high parameter efficiency. Our model decomposes control into a high-level System 2 for instruction-conditioned semantic context encoding—a frozen PaliGemma-3B backbone with 0.12B trainable LoRA parameters and a reactive System 1 for multimodal fusion and action generation. To optimize training efficiency, System 2 takes only a single egocentric image, while System 1 recovers missing context by integrating wrist-view images via ResNet-34 and proprioceptive state history encoded with a single linear projection layer. This information is fused through a Transformer Encoder, and final action trajectories are refined via a Transformer-parameterized conditional flow-matching decoder. To improve task performance, we generate diverse candidates by sampling from N independently initialized Gaussian noise vectors and using different numbers of denoising steps K per sample, and then select the executed action using a Cal-QL (Calibrated Q-Learning)-based critic. Evaluated on the standardized LIBERO benchmark, our proposed model achieved a 98.1% average success rate, outperforming contemporary fully trained models across all task suites. These results demonstrate that strategic architectural design can enable parameter-efficient models to exceed the performance of full-scale fine-tuning, offering a viable path for high-performance robotics under constrained computational resources.
State-of-the-art vision-language-action (VLA) models such as $\pi_{0.5}$ exhibit strong semantic understanding, instruction following and task behavior. However, when deployed on new robots, even minor mismatches in hardware configuration relative to pretraining can cause severe performance drops. Finetuning the VLA on in-domain expert data from the new embodiment improves performance on the expert task but leads to a loss in its original instruction following and behavioral priors. In this paper, we propose a self-supervised method that generates online interaction rollouts from the zero-shot VLA as additional training data for finetuning. Our experiments show this finetuning scheme yields strong multi-task policies that, on the target robot, (1) inherit prior tasks distilled from the zero-shot model, (2) enable generalist instruction following, while (3) learning new skills from expert data with improved sample efficiency. We demonstrate the success of our approach across test sets probing generalization on a real ALOHA robot and a new simulation benchmark in RoboTwin. Video results are available at https://self-supervised-control.pages.dev/
Prachi Garg, Steve Xing, Prahit Yaugand et al.· 0 citations
RA-VLA is presented, a retrieval-augmented VLA framework that integrates behavior-aligned context retrieval with a grounded execution pipeline that facilitates seamless task adaptation while preserving inference efficiency.
Sanghwan Jang, Minjin Jeon, Minsoo Kim et al.· 1 citation
Scaling robot data is crucial for building generalist Vision-Language-Action (VLA) models, yet robot trajectories are harder to scale than web-scale image-text data because embodied collection is costly and sparsely covers the physical world. This makes representation quality a central bottleneck: under a fixed robot-data budget, continued pre-training must turn limited trajectories into transferable visual-action knowledge rather than merely fit actions. We propose VLAct, a VLA-oriented VLM backbone trained on broad, heterogeneous, multi-embodiment robot data before task-specific fine-tuning. VLAct preserves the broad VLM prior and encourages shared action semantics across embodiments through VLM-prior preservation, multi-head continuous action co-supervision, and a partially unified cross-embodiment action layout, while allowing task-specific action heads during fine-tuning. Across simulation, real-world, and unseen-embodiment transfer, VLAct consistently improves downstream performance under fixed fine-tuning protocols. On LIBERO-Plus and RoboTwin 2.0, VLAct surpasses industrial VLA systems including ABot-M0 and LingBot-VLA, achieving success rates of 82.6% and 92.5%. On RoboDojo, VLAct ranks sixth among all policies by success rate and outperforms all explicitly designated world-action model (WAM) entries on both metrics. Most notably, on RoboCasa-GR1, an unseen humanoid embodiment, VLAct using only 20% of downstream trajectories outperforms the full-data GR00T-N1.6 baseline. These results are obtained using fully open-source data and only a 16-GPU training setup, showing that representation-centric continued pre-training can deliver highly competitive performance under a modest compute budget and is an important independent axis of VLA progress beyond data scaling.
Senqiao Yang, Chengyao Wang, Yuxin Chen et al.· 1 citation
The real-robot benchmark demonstrates that StellaVLA can use both human/robot demos and human-to-robot (XR) demos as in-context structured demonstration to help VLA model adapt to OOD tasks.
Siyu Xu, Yunke Wang, Zijian Wang et al.· 0 citations
While Vision-Language-Action (VLA) models pretrained on large-scale robot datasets provide a strong foundation for robot manipulation, their performance can degrade when adapted to new tasks with limited task-specific demonstrations. Retrieval offers a practical way to reuse existing demonstrations for data-efficient adaptation, but existing methods often rely on visual similarity, state-action representations, or task-level language matching. These approaches may overlook the hierarchical structure of long-horizon manipulation tasks, where complete task matches are rare but reusable skills are often abundant. To address this challenge, we propose Hierarchical Skill Retrieval (HSR), a retrieval framework for data-efficient VLA adaptation. Specifically, HSR first decomposes a target task into candidate skill sequences. It evaluates each plan based on both semantic plausibility and skill reliability estimated from the prior dataset. The selected decomposition is then used for hybrid retrieval. This combines subtask-level language retrieval with behavior-feature reranking to identify demonstrations that are both semantically relevant and compatible with the target task. Finally, we adapt the policy through a two-stage pretraining and finetuning pipeline, which separates general skill acquisition from task-specific adaptation. Experiments on the LIBERO benchmark and several real-world robot manipulation tasks show that HSR improves the average success rate by 10.3% and 21.3% over the strongest baseline, respectively. These results demonstrate the effectiveness of structured skill-level retrieval for data-efficient VLA adaptation. Videos and code are available at https://hoar012.github.io/HSR-Project.
Haoran Hao, Shahram Najam Syed, Jeff Schneider et al.· 0 citations
HAM-VLN is presented, a decision-coupled, agent-authored memory that equips the robot with a persistent, depth-grounded world graph and reduces the context length by more than 65% compared to previous methods.
An Liu, Bingxi Liu, Hongyu Ding et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
