Jul 2026
kappa-LoRA: Condition Numbers Reveal Which LoRA Matrices Worth Updating
It is shown for the first time that not all LoRA matrices are equally worth tuning: matrices with smaller condition numbers are already well-balanced across directions and contribute only marginally to adaptation, whereas matrices with larger condition numbers contain underdeveloped directions that span richer subspace...
Jianghui Wang, Si-Long Yong, Francesco Orabona et al.
· arXiv.org · 0 citations