Jul 2026
Super-Tuning: From Activation-Aware Pruning to Sparse Fine-Tuning
The results suggest that simple pruning-inspired orderings can provide useful fixed sparse supports for PEFT, especially when combined with low-rank adapters.
Ivan D. Ilin, Philip Zmushko, Peter Richtárik
· arXiv.org · 0 citations