Rethinking LLM Fine-Tuning via Weight Space Reparameterization: Preserving Safety during Downstream Adaptation
This work proposes WSR-Tune, a Weight Space Reparameterization-based fine-tuning framework that preserves safety during downstream adaptation and achieves a more favorable trade-off between downstream performance and safety retention, demonstrating its effectiveness for reliable LLM fine-tuning.
Minsu Kim, Jongbok Won, Jeesup Park et al.
· 0 citations