EOPSA: Efficient On-Policy Self-Distilled Safety Alignment
On-Policy Self-Distillation (OPSD) has emerged as a promising paradigm for safety alignment, delivering dense, token-level supervision by distilling from a teacher conditioned on refusal-oriented privileged prompts. However, we reveal that this paradigm suffers from critical inefficiencies that degrade both training ef...
Qi-Rui Liu, Yi-Chen Sun, Yan Wang et al.
· 0 citations