This field report presents an OpenArm-based mobile manipulation prototype for laboratory-style tasks, built by integrating dual OpenArm manipulators with a mobile base, vertical slide, RGB-D sensing, lidar-based mapping, ROS2/MoveIt execution, and profile-defined skill interfaces.
Abstract
Open-source robotics and foundation models have lowered the barrier to embodied AI, yet language-guided laboratory automation still requires reliable alignment from instructions and observations to safe actions. This field report presents an OpenArm-based mobile manipulation prototype for laboratory-style tasks, built by integrating dual OpenArm manipulators with a mobile base, vertical slide, RGB-D sensing, lidar-based mapping, ROS2/MoveIt execution, and profile-defined skill interfaces. The system is organized around representation handoffs: natural language requests are constrained into registered skill calls, sensor observations are grounded into maps and object poses, object priors provide role and skill constraints, and runtime bindings compile validated skills into executable motion goals. We use dry-run traces and startup checks to evaluate this integration path, showing how the prototype exposes missing calibration, incomplete object assets, and unfinished real-scene visual grounding as explicit deployment blockers. These intermediate representations serve as practical debugging interfaces for integrating language, perception, planning, and robot safety in embodied systems.
Putting together a multi-part assembly feels routine in human hands: we visually align parts, feel first contact, correct tiny misalignments, and decide what to do next from the evolving scene. For a robot, precision assembly is a long-horizon, contact-rich problem where millimeter-level pose errors or a mistimed actio...
Wen-Long Ma, Cheng-Long Li, Lin Wang et al.· IEEE Robotics and Automation...· 0 citations
Transparent objects, such as beakers, flasks, and other laboratory glassware, are commonly used in both laboratory and industrial settings. When light passes through these materials, it is refracted, which degrades image quality and impairs depth estimation of object surfaces. This often leads to failures in robotic pe...
Kaixin Huang, J. Zhuang, Sichao Ye et al.· IEEE Transactions on Automat...· 0 citations
Simulation and real-robot experiments show that the automatically generated interaction annotations are comparable to curated annotations, generated assets provide effective sim-to-real supervision, and tabletop cousins can improve transfer beyond training on a single reconstructed scene.
Jing-Xuan Zhu, Jing-Yuan Li, Liang-Liang Chen et al.· 1 citation
AnchorVLN is introduced, an open-vocabulary VLN system built on a simple rule: the VLM proposes semantics; geometry decides metrics, which enforces the semantic-geometry boundary without modifying the downstream autonomy stack.
Long Giang Vu, Cheng-Kai Yao, Yu-Xin Liu et al.· 0 citations
Autonomous mobile manipulators operating in dynamic environments face significant challenges due to spatial variability, diverse task requirements, and the complexities of natural language understanding. Traditional systems often lack persistent perception, fail to adapt to open-vocabulary commands, and cannot recall s...
Yuning Cao, Qing-Song Xu· Journal of Physics, Conferen...· 0 citations
Door opening and traversal is a long-horizon loco-manipulation task that requires precise handle interaction and coordinated base-arm control. We present Video2DoorTraversal, a single-video real-to-sim-to-real framework for wheel-legged mobile manipulators. Given one RGB video of a real door, DoorTwin reconstructs an i...
Xinchen Tang, Yijia Chen, Youhan Xie et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.