Qingyu Shi

Defending Against Malicious Finetuning by Scaling Train-time Adversarial Attacks

Patcher is a novel and efficient adversarial training algorithm that alternates between an attack stage and a defense stage: the attack stage simulates many-step malicious finetuning and computes the resulting parameter displacement as an"attack vector", while the defense stage aims to preserve safe behavior under such...