AutoDojo: A Generative Benchmark for Evaluating Prompt Injection Defenses in LLM Agents
AutoDojo is introduced, a generative benchmark built on AgentDojo and AgentDyn that generates IPI adaptively for a given agent and defense, and it is demonstrated that standard static benchmarks often significantly overestimate defense efficacy.
Xinhang Ma, Taoran Li, Chao-Wei Xiao et al.
· 5 citations