Using SAFERELBENCH to evaluate seven open- and closed-source VLM-driven embodied agents, this work finds a substantial gap between task success and process-level safety compliance, and shows that safe embodied intelligence requires not only stronger perception and planning, but also reliable reasoning about how object relations shape risk during interaction.
Abstract
Vision-language models (VLMs) are increasingly used as the reasoning backbone of embodied agents, enabling robots to interpret visual scenes, follow language instructions, and plan multi-step actions. In household environments, however, safety depends not only on recognizing objects, but also on how actions change the physical scene over time. Existing embodied safety evaluations largely focus on static risk recognition, unsafe instruction refusal, or final-state task completion. As a result, process-level safety failures induced by spatial relations such as support, containment, and proximity remain insufficiently studied. To address this gap, we introduce SAFERELBENCH, a spatial-relation-aware safety benchmark with 507 executable evaluation samples, including 248 spatial-relation samples and 259 non-spatial control samples. Using SAFERELBENCH to evaluate seven open- and closed-source VLM-driven embodied agents, we find a substantial gap between task success and process-level safety compliance: models often complete the requested task while violating process-level safety constraints. Unlike prior benchmarks, SAFERELBENCH explicitly tests whether agents satisfy safety conditions before risk-prone actions, making spatial relations a core dimension in embodied safety assessment. More broadly, our results show that safe embodied intelligence requires not only stronger perception and planning, but also reliable reasoning about how object relations shape risk during interaction.
SafeBranch is proposed, a framework that aligns an embodied actor on safety through branch pairs constructed from the actor's own unsafe rollouts via environment rollback, achieving roughly ten times more safe successes than the untrained baseline on the unseen-object variant.
Hyunse Lee, Jiwoo Jeong, Haneul Lee et al.· 0 citations
G2-Nav is presented, a novel framework that grounds abstract social reasoning and guards safe real-world deployment in unstructured environments by translating its semantic reasoning into a vision-language costmap with reliability and interpretability.
Yuwen Liao, Yihang Lan, Yizhuo Yang et al.· arXiv.org· 0 citations
This work introduces SkillLogic, a framework for analyzing logical relations in skill files and constructing executable tests from them, and establishes logical-relation following as a distinct reliability challenge for skill-guided agents.
Xuan Chen, Chengpeng Wang, Lu Yan et al.· arXiv.org· 0 citations
This work presents a systematic study of physical prompt injection attacks against VLM-controlled sorting, introducing a four-category taxonomy, indirect signage, task redefinition, authority impersonation, and conflict injection, instantiated as a benchmark.
S. Samarakoon, M. V. J. Muthugala, W. K. R. Sachinthana et al.· 1 citation
While standard end-to-end baselines struggle to complete these logically demanding tasks, ACE achieves a 50% success rate in equation formation and a 70% success rate in constraint retrieval, demonstrating that explicit workflow reasoning and mask-mediated control offer a robust, practical route toward adaptable roboti...
Iok Tong Lei, Qianzhi Li, Ying Jie Yap et al.· arXiv.org· 0 citations
Robotic manipulation in complex scenes requires robust reasoning and fine-grained part-level control. While recent language-guided policies have demonstrated strong manipulation capabilities, most existing benchmarks lack explicit obstacles and other sources of interference, and do not provide corresponding obstacle-aw...