Skip to content

Grasp-Oriented Non-Prehensile Manipulation via Learning a Graspability Field

Jun 2026 · arXiv.org · Vol abs/2606.30474 · 0 citations · 51 references
Computer Science

Abstract

Non-prehensile manipulation is often used as a preparatory step for robotic grasping, yet existing approaches typically require a predefined target object pose. In practice, however, objects admit multiple graspable configurations and the desired pose is not known in advance. We reformulate non-prehensile manipulation for grasping as optimizing an object centric graspability objective rather than reaching a specific pose. We construct a graspable set from synthesized grasps and define a graspability field that measures how suitable an object configuration is for successful grasp execution. The scalar measure provides a dense learning signal for reinforcement learning and determines when to terminate manipulation. This yields a closed-loop manipulation-to-grasp pipeline driven by a single policy. Experiments in simulation and on a real robot show that the policy reliably reconfigures objects into graspable states and transitions to grasping without external planners or manually specified stopping conditions. The predicted graspability distance correlates with real world grasp success, which indicates that the learned representation captures grasp feasibility of object configurations.

View source

Similar papers

Preprint Jul 2026

GraspGraphNet: Graph-Structured Multi-Embodiment Dexterous Grasp Generation

Dexterous grasp generation across robot hands is challenging because hands differ in kinematic topology, actuation dimensions, and native command spaces. We introduce GraspGraphNet, a topology-aware grasp generation framework that represents each hand as a URDF-derived kinematic graph and directly generates executable palm poses and joint configurations. GraspGraphNet combines hierarchical object surface encoding, differentiable forward kinematics, and dynamic world-edge message passing to model evolving robot-object interactions. It applies conditional flow matching directly in executable palm-pose and joint-state space, avoiding post-processing optimization, inverse kinematics, and retargeting. Using a shared model trained on Barrett Hand, Allegro Hand, and Shadow Hand, GraspGraphNet achieves an average success rate of 83.48% with 40ms inference time per grasp on a 40-object benchmark. Without retraining, the same model achieves 72.70% success on controlled finger-removal variants, demonstrating robustness to hand-topology variations. These results suggest that graph-structured hand representations can effectively support dexterous grasp generation across robot hands with different kinematic structures. Project: https://lysees.github.io/graspgraphnet-page

Y. Lee, Taeyeop Lee, Hyosup Shin et al. · 0 citations
#artificial intelligence Preprint Aug 2026

Iterative Grasp Pose Refinement: A Deep Reinforcement Learning Approach for 2D Vision

A reinforcement learning-based framework for robotic grasp refinement, integrating keypoint-based object representations with a Deep Q-Network (DQN), is proposed, offering a scalable and adaptable solution for contact-rich manipulation tasks.

Amir Arsalan Nematollahi, Shayan Ahmadi, M. T. Masouleh et al. · 0 citations
Preprint Aug 2026

GOAG: Generative and Object-Agnostic Grasp Planner for Dexterous Robotic Manipulation

Multifingered grasping is a crucial robotic skill, but current deep-learning grasp planners often struggle to generalize to new objects because they are trained on limited, object-specific datasets. We introduce a fundamentally different approach, grounded in the observation that the gripper and the object share identical surface geometry at their mutual contact points. We propose GOAG: Generative and Object-Agnostic Grasp Planner for Dexterous Robotic Manipulation, a novel deep generative model that learns a compact latent representation of a specific gripper's contact surface distribution, enabling the efficient sampling of valid grasp configurations without relying on object-specific training data. We show that by introducing object features only at inference time, our model can effectively retrieve admissible contact areas that are compatible with the gripper's capabilities. We validate our approach through extensive experiments on established grasp protocols in both simulated and real-world scenarios, demonstrating its effectiveness with different grippers from the literature. Our method delivers state-of-the-art results on the objects from the MultiDex dataset, achieving an average success rate of 86.93%. It offers significantly faster processing when generating numerous grasps, while matching the performance of leading approaches specifically trained on this dataset. Unlike these methods, our approach does not rely on object-specific training data, highlighting the advantages of object-agnostic learning. It effectively addresses the generalization challenges faced by traditional data-driven grasp planners. Code and videos are available on our project website https://cea-list.github.io/goagweb/ .

Julien Mérand, Boris Meden, Mathieu Grossard et al. · 1 citation
Preprint Aug 2026

Real-World Cooperative Bimanual Dexterous Grasp of Large Objects from Single-View Observations

Bimanual dexterous grasping of large objects is a critical challenge in robotic manipulation. However, most existing studies focus on sequential manipulation rather than cooperative grasping, and methods addressing such bimanual tasks have largely been limited to simulation. These limitations stem from the difficulty of acquiring full 3D object models and generating physically plausible grasping actions. To fill this gap, we propose a real-world bimanual grasping framework that includes: a multimodal dataset capturing joint angles, visual observations and force signals; a Denoising Diffusion Probabilistic Model (DDPM)-based module that generates joint-level grasp configurations from segmented point clouds; and an execution strategy that integrates motion planning with online grasp refinement to ensure physical stability and feasibility. Our approach enables the synthesis of executable bimanual grasps from single-view inputs, reducing dependence on complete 3D object models and ensuring stable real-world performance. Experiments on a dual-arm robot demonstrate high success rates across unseen objects with varying geometries and poses, and ablation studies confirm the contributions of key components of our system.

Ziming Li, Mingxuan Wu, Jiaqi Zhang et al. · 0 citations
Preprint Aug 2026

CoToGrasp: Contact-Topology-Conditioned Dexterous Grasp Synthesis via Canonical Workspace Learning

Current dexterous grasp planners primarily optimize for physical stability, focusing on whether an object can be grasped rather than how it should be grasped to support downstream functional tasks. However, conditioning grasp synthesis on specific human grasp taxonomies typically requires prohibitively expensive, object-annotated datasets. To address these limitations, we propose CoToGrasp, a novel generative framework that synthesizes diverse, stable grasps strictly conditioned on specific contact topologies. To bypass the data collection bottleneck, CoToGrasp is trained entirely in an object-agnostic manner. We introduce a feature-based canonical workspace that projects local object features into a unified gripper-centric domain, effectively decoupling the semantic functional intent from the arbitrary object geometry. By learning the intrinsic contact manifold of the gripper within this workspace, our model achieves zero-shot generalization to unseen objects at inference. Extensive evaluations on the large-scale DexGraspNet dataset demonstrate that CoToGrasp achieves state-of-the-art performance, outperforming existing taxonomy-guided planners. Finally, we demonstrate the physical viability and kinematic feasibility of our synthesized contact topologies on a physical robot platform. Code is available on our project website at https://cea-list.github.io/cotograspweb/ .

Julien Mérand, Boris Meden, Liming Chen et al. · 1 citation
Open access Jul 2026

DexGraspDiffuser: Target-Coupled Grasp and Action Diffusion for Dexterous Grasping

Dexterous grasping with multi-finger robotic hands is essential for general-purpose robotic manipulation, but remains challenging due to high-dimensional hand configurations, multimodal grasp distributions, and contact-rich execution dynamics. Existing methods often decouple grasp target generation from execution policy learning, which limits the consistency between generated grasp goals and downstream control. To address this problem, we propose DexGraspDiffuser, a target-coupled grasp and action diffusion framework for dexterous grasping. The first stage, GraspDiffusion, generates diverse and physically plausible target grasps from object point clouds using a compact representation of hand root translation, continuous rotation, and finger joint configuration. The second stage, a Goal-Conditioned Diffusion Policy, predicts temporally coherent action sequences conditioned on the selected target grasp and current observation. During inference, receding-horizon execution enables action-prefix execution and online replanning for improved robustness. Experiments demonstrate that DexGraspDiffuser achieves success rates of 0.76, 0.72, and 0.68 on training objects, unseen objects from seen categories, and objects from unseen categories, respectively. These results correspond to a three-split average success rate of 0.72 and a train-to-unseen generalization gap of 0.08. Compared with the reproduced UniDexGrasp-T baseline under the same object split and evaluation protocol, DexGraspDiffuser improves the three-split average success rate by 3.3 percentage points and reduces the average mean position error by 0.53 cm. This indicates that target-coupled grasp and action diffusion contribute to improved grasp quality, execution accuracy, and closed-loop stability.

Juncheng Zhu, Haotian Yang, Zhile Yang et al. · 0 citations