Skip to content

Category

robotics

1,183 papers

#robotics Preprint Open access Sep 2026

MarineCraft: Enabling Rapid Prototyping of Underwater Robots via Modular Construction

Underwater robot development is often hindered by the complexities of waterproofing and wiring, which significantly delay the rapid prototyping process. This paper presents MarineCraft, a modular toolkit designed to accelerate the development cycle through structural reconfiguration. The system features self-contained,...

Yuta Sugiura · 0 citations
#robotics Preprint Open access Sep 2026

OpenRoIS: A Community-Driven Open-Source Middleware Implementing the Robotic Interaction Service (RoIS) Framework for Physical Robots and Virtual Agents

Service applications for human-robot interaction are commonly written against the hardware-specific interfaces of one platform, so a change of hardware forces a rewrite of the application. The Robotic Interaction Service (RoIS) Framework 2.0, standardized by the Object Management Group (OMG), addresses this fragmentati...

Sebastian Carrera Villalobos, Christopher Nolan Arellano, Arne Hitzmann et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Provably Optimal Reinforcement Learning under Safety Filtering

Recent advances in reinforcement learning (RL) enable its use on increasingly complex tasks, but the lack of formal safety guarantees still limits its application in safety-critical settings. A common practical approach is to augment the RL policy with a safety filter that overrides unsafe actions to prevent failures d...

Donggeon David Oh, Duy P. Nguyen, Haimin Hu et al. · 0 citations
#machine learning Preprint May 2025

Trajectory Entropy Reinforcement Learning for Robust Robot Motor Skill Learning

This work introduces a novel inductive bias towards simple policies in reinforcement learning by minimizing the entropy of entire action trajectories, corresponding to the number of bits required to describe information in action trajectories after the agent observes state trajectories.

Bang You, Chenxu Wang, Wen-Ju Yang et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Rollout Total Correlation for Deep Reinforcement Learning

Learning task-relevant representations is crucial for reinforcement learning. Recent approaches aim to learn such representations by improving the temporal consistency in the observed transitions. However, they only consider individual transitions and can fail to achieve long-term consistency. Instead, we argue that ca...

Bang You, Huaping Liu, Jan Peters et al. · 0 citations
#machine learning Preprint Open access Sep 2026

From Pretraining to Proficiency: Real-World Subtask RL for Long-Horizon Manipulation with Minimal Human Intervention

A pretrained robot foundation policy may execute most of a long-horizon task yet repeatedly fail at a few critical subtasks. Collecting additional full-task demonstrations for supervised fine-tuning (SFT) requires operators to repeat behaviors the policy already performs well. Reinforcement learning (RL) fine-tuning of...

Sichang Su, Benjamin Yang, Zhiyun Deng et al. · 0 citations
#machine learning Preprint Sep 2026

Adaptive Rollout Truncation Based on Epistemic Uncertainty for Efficient Offline World Model Training

The proposed epistemic uncertainty-driven adaptive rollout strategy for offline world model training following an auto-curriculum training scheme indicates that epistemic uncertainty is useful not only for downstream policy regularization, but also for making world model training itself more compute-efficient.

Nikodem Sebastian Zymla, Laurin Thiele, Johannes Pitz · 0 citations
#machine learning Preprint Sep 2026

FootQuery: Future-Touchdown-Guided Retrieval from Depth History for Perceptive Humanoid Locomotion

FootQuery is presented, a perceptive locomotion framework that queries depth history using each foot's predicted next touchdown using each foot's predicted next touchdown to organize visual history around anticipated contacts for perceptive humanoid locomotion.

Tao Dong, Jia Yu, Yuxuan Fan et al. · 0 citations
#machine learning Preprint Open access Sep 2026

Diverse and Adaptable Arm Coordination for Octopus-Crawling via Diffusion-Based Uncertainty-Aware Optimization

Octopus crawling motivates soft robots that exploit redundancy, yet discovering and organizing diverse coordination modes for adaptation remains challenging. To address this, we introduce a Diffusion-based Uncertainty-aware Optimization (DUO) algorithm that learns demonstration-free crawling controllers for a simulated...

Seung Hyun Kim, Heng-Sheng Chang, Kimia Kazemi et al. · 0 citations
#machine learning Preprint Sep 2026

Benchmarking World Models for Continual Learning on Compositional Tasks

This work designs each task curriculum with compositional tasks that combine aspects of the tasks seen in the sequence, and factorise this composition along the axes of action and perception to better understand how different input modalities bottleneck knowledge reuse.

Hao-Yu Zhou, Joe Watson, Anson Lei et al. · 0 citations
#machine learning Preprint Sep 2026

Beyond Kinematics: Benchmarking Simulation Fidelity for Muscle-Driven Imitation Learning

A systematic comparison of two state-of-the-art motion-imitation reinforcement learning (MIRL) pipelines, one built on SCONE/HyFyDy and one built on MuJoCo/MyoSim, concludes that the more advanced physiological realism of HyFyDy currently makes it more suitable for musculoskeletal modeling.

Ayah Ahmad, Claire E. Borden, Maegan Tucker · 0 citations
#machine learning Preprint Open access Sep 2026

Signal-Centric Remote Sensing via Alternative Preprocessing and Acoustic Processing for ML-Driven Applications

The dominant method of processing sonar data is using image-based representations, requiring the preprocessing of image data on autonomous systems. We propose an alternative data processing method for remote sensing applications via the use of data in Comma-Seperated Value format. Experimentation on our alternative app...

Logan Luna, Sirio Jansen-S\'anchez, Ilteris Demirkiran et al. · 0 citations

From tech blogs

See all →
Microsoft Research Blog Sep 23, 2026

Offloaded inference for real-world physical AI robotics

Robots are getting smarter, but how can their hardware match that growth? New Microsoft Research findings show that moving AI inference beyond the robot can improve task success, boost efficiency, and support more advanced physical AI workloads. The post Offloaded inference for real-world physical AI robotics appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.