Skip to content
Review

Security of Foundation-Model-Powered Embodied Agents: Attack Surfaces, Attacks, Defenses, and Evaluation

Aug 2026 · 0 citations · 123 references
Computer Science

TL;DR

This work presents a trust-boundary-centric survey of foundation-model-powered embodied-agent security, and shows that attack research is concentrated on multimodal perception and action interfaces, while defenses are especially concentrated on action-level and runtime protection.

Abstract

Foundation models are increasingly used for perception, reasoning, planning, and action generation in embodied agents, creating security risks that can propagate from digital inputs to physical behavior. Existing surveys often organize threats by mechanisms such as jailbreaks, prompt injection, backdoors, poisoning, or adversarial examples, but these categories do not consistently identify where an adversary first enters the embodied control loop. We present a trust-boundary-centric survey of foundation-model-powered embodied-agent security. Using a first-compromised-trust-boundary principle, we separate attack surface from attack mechanism and organize the system into five layers and twelve attack surfaces spanning the model supply chain, user instructions, context and memory, physical semantic environments, multimodal perception, world state, internal reasoning, task planning, action interfaces, middleware, multi-agent communication, and execution control. Based on 58 attack records and 61 defense records collected through August 15, 2026, we analyze representative attacks, cross-layer propagation, defense placement, and evaluation practices. Our quantitative analysis shows that attack research is concentrated on multimodal perception and action interfaces, while defenses are especially concentrated on action-level and runtime protection. Context and long-term memory, middleware and networking, world-state integrity, and multi-agent trust remain comparatively underexplored. We conclude with open challenges in state provenance, compositional defenses, long-horizon attack propagation, physical realizability, Byzantine multi-robot behavior, and unified closed-loop evaluation.

View source

Similar papers

Review Jul 2026

Security of World-Model-Based Embodied AI: A Lifecycle of Threats, Defenses, and Evaluation

This survey offers a lifecycle taxonomy, maps existing attacks to world-model security properties, outlines evaluation protocols for safety failures, and structures defenses across provenance, robust grounding, uncertainty-aware prediction, trajectory gating, feedback auditing, and deployment assurance.

Fazhong Liu, Zhuo Chen, Haozhen Tan et al. · 3 citations
Review Jul 2026

Cyber-Capable AI Agents: Vulnerabilities, Evaluation Containment, and Defensive Response

Cyber-capable AI agents combine language models with tools, memory, and execution environments to perform multi-step offensive-security tasks. Existing work separately measures cyber capability and catalogs attacks against agent components, but provides less guidance on containing a capable agent within the environment...

A. B. Siddik · 0 citations
Open access Jul 2026

Invariant-Centered, Agent-Assisted Defense: A Security Architecture for Unbounded Attack Techniques and Unenumerable Attack Objectives

A defensive architecture for under unbounded attack techniques and unenumerable attack objectives, where the highest-value security investments are those that hold regardless of technique, and relocates residual reactivity to a single measurable point.

Ajayi Abisoye, N. Hussain, Abolaji Adebayo · 0 citations
#human-computer interacti... Open access 2026

Toward a Unified Security Systems Theory for Autonomous AI Systems

This paper synthesizes the findings of the five-paper AI Agent Security Series into a unified, formal, and falsifiable theory of autonomous agent security, and establishes three meta-theorems: the Component Insufficiency Theorem, the Dynamic Necessity Theorem, and the Interaction Irreducibility Theorem.

Harsh Verma · 1 citation
#large language models Open access 2026

Clean Attacks: Formalizing Semantically Valid Adversarial Behavior in Autonomous AI Agent Systems

A previously unstated class of adversarial input called a clean attack - an input that is syntactically correct, semantically consistent with the declared task context, consistent with all observable policy constraints and still has the goal of misguiding the agent away from the original operator goal - is identified a...

Harsh Verma · 1 citation
Preprint Aug 2026

Adversarial Attacks in Multi-Agent LLM Pipelines: Unveiling Structural Vulnerabilities in Agentic AI Architectures

It is argued that adversarial vulnerability stems from the absence of boundary verification, a security primitive that enforces explicit validation of data as it crosses inter-agent boundaries, including content, identity, execution intent, and state integrity.

Faisal Haque Bappy, Tahrim Hossain, T. S. Zaman et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.