Jacob Epifano

Correct, Don't Delete: Mitigating Emergent Misalignment with Corrective Supervision

It is found that a short round of training on corrections beats the same amount of training on generic chat data, that corrections on other medical prompts do roughly as well as corrections of the poisoned prompts themselves, and that instructing the correction writer to model a careful, harm-avoiding assistant adds no...