The Safety Operator: Modulating the Expression of Safety Instructions via Spectral Optimization
A Contrastive Safety Loss is derived with a suppression weight that controls the tradeoff between emphasizing the safety instruction on harmful queries while suppressing it on harmless queries, supporting the hypothesis that the operator's eigenvalue acts as a continuous dial for the instruction's influence.
Benoit Dherin, Michael Munn, X. Gonzalvo et al.
· 0 citations