Skip to content

Category

robotics

1,183 papers

#artificial intelligence Preprint Open access Sep 2026

Mem2Ego: Empowering Vision-Language Models with Global-to-Ego Memory for Long-Horizon Embodied Navigation

Recent advancements in Large Language Models (LLMs) and Vision-Language Models (VLMs) have made them powerful tools in embodied navigation, enabling agents to leverage commonsense and spatial reasoning for efficient exploration in unfamiliar environments. Existing LLM-based approaches convert global memory, such as sem...

Lingfeng Zhang, Yuecheng Liu, Zhanguang Zhang et al. · 0 citations
#artificial intelligence Open access Mar 2025

SurgRAW: Multi-Agent Workflow With Chain of Thought Reasoning for Robotic Surgical Video Analysis

This work introduces SurgCoTBench, the first reasoning-focused benchmark in RAS, and proposes SurgRAW, a clinically aligned Chain-of-Thought (CoT) driven agentic workflow for zero-shot multi-task reasoning in surgery, which surpasses mainstream VLMs and agentic systems and outperforms a supervised model.

Chang Han Low, Ziyue Wang, Tianyi Zhang et al. · 20 citations · ⚡2
#artificial intelligence Preprint Open access Sep 2026

Dreaming the Sound of Contact: Leveraging Video and Audio Generation for Zero-Shot Force-Aware Manipulation and Data Generation

Recent advances in video generation allow robots to learn manipulation trajectories from generated videos. However, these approaches produce purely kinematic trajectories that lack force information, causing failures in contact-rich tasks where appropriate contact forces are essential for success. In this work, we expl...

Guanhua Ji, Tianyu Li, Dayoon Suh et al. · 0 citations
#artificial intelligence Preprint Sep 2026

rMuscle: Robotic Muscle Memory for Efficient Vision-Language-Action Model Inference

Factory work is a promising early scenario for embodied AI: assigning repetitive manual jobs to robots has clear economic payoff, and a structured station keeps the jobs tractable for current policies. Vision-Language-Action (VLA) models now dominate as the policy paradigm for these robots. The inference latency of VLA...

Kai-Jun Zhou, Zhi-Yang Li, Le Chen et al. · 0 citations
#artificial intelligence Preprint Sep 2026

ActionPiece: Rethinking Action Tokenization for Autoregressive Vision-Language-Action Models

This work introduces physical rank consistency (PRC) to measure how well tokenization preserves local physical distance rankings after reconstruction, and presents ActionPiece, which preserves physical action relationships through joint supervision of representation learning and quantization.

Shijie Lian, Bin Yu, Zhao-Long Shen et al. · 1 citation
#artificial intelligence Preprint Sep 2026

M2Tok: Multi-head Multi-codebook Discrete Action Tokenization for Vision-Language-Action Models

Experimental results demonstrate the proposed ${M}^2$Tok, a Multi-head Multi-codebook Action Tokenizer designed to minimize reconstruction error and enhance policy performance, achieves superior reconstruction fidelity and significantly boosts the success rate of VLA models.

Chun-Pu Xu, Zhi-Xuan Liang, Yu-Hao Zhang et al. · 0 citations
#artificial intelligence Review Open access May 2026

A Comprehensive Review of Generative Physical Artificial Intelligence

This article comprehensively analyzes GPAI systems, focusing on their architectural foundations, current applications, and key limitations, and summarizes promising research directions in data-efficient learning, sim-to-real transfer, edge-compatible architectures, and safety frameworks.

Satyam Gaba, Krutiksinh Rana, Siva Sai et al. · 6 citations · ⚡1
#artificial intelligence Preprint Sep 2026

RoboVAD: A Large Cross-Domain Evaluation Benchmark for Anomaly Detection in Robotic Arm Manipulation Videos

While the proposed method outperforms many state-of-the-art competitors, all methods remain below a micro-averaged frame-level AUC threshold of 70% in the most challenging evaluation setup, confirming the difficulty of the proposed benchmark.

Alexandru-Bogdan Dura, Sebastian Balmuş, Radu Tudor Ionescu · 0 citations
#artificial intelligence Preprint Open access Sep 2026

Learning Multi-Humanoid Pickup and Transport via Decentralized Object-Centric Control

We study cooperative multi-humanoid pickup and transport of objects with varying size, weight, and geometry, requiring robot teams of different sizes. Our approach uses decentralized object-centric control, where each humanoid is assigned a local attachment region on the shared object and learns to realize pickup and t...

Bikram Pandit, Mohitvishnu S. Gadde, Aayam Kumar Shrestha et al. · 0 citations
#artificial intelligence Preprint Sep 2026

HINT-Plan: Human Intention-Aware Robot Task Planning in Context-Rich Environments using Vision Language Models

Approaches to incorporating human awareness into mobile robot decision-making mainly focus on collision avoidance in low-level motion planning, often overlooking the challenges posed by human presence and high-level behavior. To address this vacancy, we present HINT-Plan, a novel approach to integrate human intention p...

Yu-Chen Liu, Luigi Palmieri, Lujun Li et al. · 0 citations
#artificial intelligence Preprint Sep 2026

CALOS: Control-Affine Lyapunov On-manifold Safety Layer for Safe Deep Reinforcement Learning for Quadrotors

CALOS (Control-Affine Lyapunov On-manifold Safety), a runtime safety layer that enforces attitude constraints on a quadrotor without modifying the underlying learning algorithm, accelerates training convergence and improves data efficiency without producing suboptimal policies.

Fabrizio Cesareo, Sebastiano Mengozzi, N. Mimmo et al. · 0 citations
#artificial intelligence Preprint Sep 2026

REVERSAL-BENCH: A Reversibility Axis and Reset Oracle for Measuring the Reset-Free RL Cliff

REVERSAL-BENCH is introduced, a benchmark that controls reversibility via a continuous parameter $\rho$ and provides a reset oracle, a ground-truth verification mechanism to test state recoverability across eight manipulation settings in five physics engines and a safety shield that intervenes before irreversible failu...

Riyaaz Shaik, Chandru Venkataraman · 0 citations

From tech blogs

See all →
Microsoft Research Blog Sep 23, 2026

Offloaded inference for real-world physical AI robotics

Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.