A unified framework that decouples the manipulation into a strategy generator and an action execution module, which generalizes effectively to unseen objects and categories, outperforming existing baselines is proposed.
Abstract
Robotic manipulation of flat objects is challenging due to the ungraspable configurations and strong variations in object geometry and material. Existing methods rely on heuristic pre-manipulation and are often evaluated in closed settings with limited generalization. We propose a unified framework that decouples the manipulation into a strategy generator and an action execution module. The strategy generator predicts appropriate manipulation strategies from object point clouds by learning strategy-centric, object-invariant representations via simulated data transformation and contrastive learning. Conditioned on the predicted strategy, the execution module decomposes long-horizon manipulation into reusable action primitives and dynamically composes them to generate stable trajectories. To enable systematic evaluation, we introduce FlatLab, a comprehensive simulation benchmark for robotic flat object manipulation. FlatLab provides high-fidelity physical simulation of diverse rigid and deformable flat objects, automated multi-modal data collection, and standardized task definitions and evaluation protocols. Experiments conducted in FlatLab demonstrate that our approach generalizes effectively to unseen objects and categories, outperforming existing baselines. The project page and the code are provided at https://flatlab-web.github.io/.
RoboFolDeX is introduced, a physical-world benchmark built entirely from real-robot data, with garment folding as its primary task, and a fair real-robot evaluation platform for externally submitted policies, with standardized tasks, held-out physical objects, controlled initializations, and a unified execution protoco...
High-precision insertion remains a fundamental challenge in robotic manipulation due to the strict alignment requirements and contact-rich interactions involved. Although peg-in-hole tasks are widely used for evaluation, existing bench- marks often rely on fixed task configurations, limiting their ability to assess rob...
Y. Delgado, José G. Buenaventura-Carreón, Floris Erich et al.· 2 citations
Capturing a loose object inside a spacecraft requires a robot to approach a target that can translate and rotate, and whose motion changes when contact is made. These conditions motivate evaluation beyond manipulation of supported objects. We introduce AstroBench, an open benchmark for free-floating capture and space r...
Zi-Zhe Wang, Jia-Yong Deng, Xin Lu et al.· 0 citations
Simulation and real-robot experiments show that the automatically generated interaction annotations are comparable to curated annotations, generated assets provide effective sim-to-real supervision, and tabletop cousins can improve transfer beyond training on a single reconstructed scene.
Jing-Xuan Zhu, Jing-Yuan Li, Liang-Liang Chen et al.· 1 citation
Adapting robots to new objects and tasks requires interaction experience that can be costly to obtain. We present WorldContact, a contact-centric world model for deformable-object manipulation, constructed from a limited set of high-quality trajectories to generate additional training data efficiently. It predicts obje...
Caoliwen Wang, Meng-Di Wang, Heng Zhang et al.· 0 citations
Robotic manipulation demands generalist systems that adapt to diverse tasks without task-specific retraining. Typically, these roles are handled by foundation models for high-level planning or simulation for motion validation, but existing approaches fail to unify semantic reasoning with physical feasibility checks bef...
Gustav Bay Baastrup, Kasper B. Lauritsen, Signe Møller-Skuldbøl et al.· IEEE International Conferenc...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.