DARWIN: Evolving Jailbreak Adversary and Guardrail for LLM Safety Evaluation and Protection
DARWIN, an evolutionary attack-defense framework that models jailbreaking as a continual process and updates guardrails through an attack-defense loop is proposed, an evolutionary attack-defense framework that models jailbreaking as a continual process and updates guardrails through an attack-defense loop.