This work identifies the attacker's adaptive search over the system attack surfaces as an important and underexplored security risk for tool-using agents and suggests that agentic security evaluations should characterize both the attacker's search procedure and compute budget.
Abstract
We formulate indirect prompt injection as a test-time search over a task-dependent attack surface induced by the environment, user task, and injection task. To operationalize this formulation, we introduce an agentic attacker with a dedicated search harness that performs environment reconnaissance, structured reasoning over attack strategies, and adaptive evaluation using victim-agent feedback. Across heterogeneous tasks, we find that increasing attacker test-time compute improves vulnerability discovery and exploitation, while ablations show that explicit strategy management is important for avoiding redundant search and sustaining gains at larger budgets. These results suggest that agentic security evaluations should characterize both the attacker's search procedure and compute budget, rather than treating attack success as a budget-independent property of the victim. More broadly, our findings identify the attacker's adaptive search over the system attack surfaces as an important and underexplored security risk for tool-using agents.
CoDeL is presented, a defense that hardens agent against an attack distribution it reshapes as it trains, and reduces attack success rate (ASR) by 88.5% and outperforms other baselines largely (+38.0%).
Xiao Yang, Yang-Chen Ou, Yu-Han Gao et al.· 1 citation
Two universal tool-based defenses are introduced: Attacker Tool Filtering, which uses anomaly detection to identify and remove suspicious tools, and Normal Tool Recalling, a white-box method that restores the agent's original toolset prior to planning.
The findings show that defense evaluation should report attack outcomes, goal feasibility, legitimate-task utility, action availability, operational measures, and run-to-run variation.
Adil Khan, Khaled AlKhanbashi, Azza Mohamed· Computers· 2 citations
Agentic systems are now being widely used to orchestrate tools and reason over long contexts. However, the improving capabilities of the large language models powering these agents also create new attack surfaces for indirect prompt injection. In particular, an attacker may not need to place a complete malicious instru...
Michael E. M. Lee, Zhi-Peng Wei, Yue Dong et al.· 0 citations
This work forms attack and defense as partially observed state control in SEAD, deriving their design requirements from this shared execution process and constructs an environment-verifiable dataset integrating controlled initial states, replayable tool environments, and task-specific executable checks.
Xin-Jie Shen, Jun-Ran Wang, Rong-Zhe Wei et al.· 0 citations
It is argued that evaluation validity is a prerequisite for, not a footnote to, defense claims in agentic security, and a harness is provided to provide an instrument that enforces it.