GPT-Red, an automated red-teaming agent that is trained to discover novel prompt injection attacks against frontier LLMs, is introduced, a scalable self-play algorithm where the model is tasked with attacking a diverse population of simultaneously-trained defender agents.
Eric Wallace, Christopher A. Choquette-Choo, Nikhil Kandpal et al.· arXiv.org· 2 citations
This work instantiates Feedback-Augmented Self-Distillation (FA-SD), a self-distillation algorithm for agentic search that leverages successful demonstrations as privileged information and identifies that models can rely on recurring reasoning-and-search output templates, producing trajectories that appear diverse but...
Fan Yang, Rui Meng, Yuxin Wen· arXiv.org· 1 citation· ⚡1
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.