AutoDojo: A Generative Benchmark for Evaluating Prompt Injection Defenses in LLM Agents
AutoDojo is introduced, a generative benchmark built on AgentDojo and AgentDyn that generates IPI adaptively for a given agent and defense, and it is demonstrated that standard static benchmarks often significantly overestimate defense efficacy.