An Emergent Mirage: Is Emergent Misalignment and Realignment Indeed a Robust Phenomenon?
This work systematically study repeated alignment and misalignment cycles using controlled fine-tuning loops while tracking behavioral performance, and LoRA representations throughout training, finding that both misalignment and realignment are highly sensitive to superficial dataset characteristics.