Skip to content
Preprint

Replicate What Varies: Resource Sharing for Domain-Randomized Embodied Simulation

Oct 2026 · 0 citations · 39 references
Computer Science

TL;DR

This work presents Patchwork, a resource-sharing system for domain-randomized simulation, built around the representation $E=T+\Delta$: a shared template contains common resources, and a patch records the mutations needed to construct a target environment.

Abstract

Simulation provides a low-cost sandbox where embodied agents can attempt tasks, observe outcomes, and learn from experience. Running many diverse simulation environments concurrently can consume substantial CPU and GPU memory because independently constructed scenes duplicate resources that remain unchanged across instances. We present Patchwork, a resource-sharing system for domain-randomized simulation, built around the representation $E=T+\Delta$: a shared template contains common resources, and a patch records the mutations needed to construct a target environment. Patchwork separates randomization sampling from replay and selects reusable templates together with patches that preserve each target environment's intended configuration. Its layered runtime shares compiled model structure and immutable assets while keeping mutable parameters and simulation state private to each instance. We implement Patchwork on robosuite and MuJoCo and evaluate it on LIBERO-plus and RoboCasa365 workloads. At 32 replicas, shared-template execution reduces CPU RSS by 88-92% relative to process-per-environment execution. Controlled experiments show how sharing shifts memory growth toward template diversity and unique asset content rather than instance count, within the supported sharing boundaries.

View source

Similar papers

CUA-Sandbox: Efficient Environments for Computer-Use Agent Reinforcement Learning

CUA-Sandbox is introduced, which separates private state capsules from shared runtimes through state-scoped execution and transactional lifecycle operations, including resets and branches, while retaining the original software interfaces and task evaluators.

Xin Yan, Zheng-Bo Jiao, Jia-Qi Liu et al. · 2 citations
#artificial intelligence Preprint Nov 2026

RoboScope Kit: Unified Interfaces for Fast and Scalable Embodied-AI Evaluation

Simulation benchmarks are the standard way to compare robot policies, but each benchmark brings its own evaluator, observation layout, and action convention, and evaluation is slow: 500 RoboTwin Easy episodes with one simulator and one model on one GPU take 359.7 minutes. Profiling the official StarVLA evaluator shows...

Deng-Ke Wu, Yinhaoyu Jin, Yi-Da Yang et al. · 0 citations
#artificial intelligence Preprint Oct 2026

Agentic World Modeling for Agent Test-time Scaling without Environment Replica

Interactive, read-grounded simulation is established as a practical foundation for safe and scalable agentic test-time scaling in shared, non-resettable environments and reforms next-observation prediction as a multi-turn evidence-acquisition task.

Wen-Di Li, Huseyin A. Inan, Wei-Ning Chen et al. · 0 citations

EBRL: Asynchronous Embodied RL by Multi-Grained Resource Management

Embodied reinforcement learning (RL) improves model capabilities with a pipeline of environment simulation, action generation, and model updates. These stages show heterogeneous CPU and GPU demands, making efficient resource utilization difficult. Recent systems overlap rollout (simulation and generation) with training...

Liang Mi, Wei-Jun Wang, Bo-Wen Gao et al. · 1 citation
Preprint Oct 2026

EnvSched: Environment-Aware Scheduling for Rollout-Efficient Agent Reinforcement Learning

As executable environments for language agents scale, generating and verifying their rollouts becomes increasingly expensive. Under finite rollout budgets, this raises an important question: can data management at the environment level make agentic reinforcement learning (RL) more efficient by organizing, evaluating, a...

Sihan Yang, Wei Bai, Rui-Chuan An et al. · 0 citations
Preprint Nov 2026

Rose: Efficient Embodied RL through Graph Optimization and GPU Compute Resource Control

Embodied reinforcement learning (RL) coordinates policy inference, simulation, and model training with highly heterogeneous resource demands. Although individual components frequently underutilize GPU compute during execution, existing systems only overlap work at coarse component boundaries (e.g., pipelining inference...

Wen-Han Zeng, Ke Hong, Xu Fu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.