Conference
Open access
2026
Soft Orthogonal Low-Rank Adaptation for Knowledge Sharing in Large Language Model Continual Learning
This work proposes At-tribution Scores-based Soft Orthogonality Low-Rank Adaptation (ASO-LoRA), an effective and efficient framework that simultaneously facilitates knowledge transfer while mitigating catastrophic forgetting and achieving a balance between knowledge transfer and preservation.
Yitong Wang, Xue Han, Wenchun Gao et al.
· Annual Meeting of the Associ... · 0 citations