SafeEvo: Deciphering the Safety Alignment Mechanism and Evolution in Language Models
SafeEvo first applies an optimization-based extraction algorithm to identify weak refusal circuits in pretrained base LLMs that can independently express refusal behavior and traces the evolution of refusal circuits across successive alignment checkpoints and finds that their structures change progressively, suggesting...