Zhekai Du

Triplet Decomposition and Extensions: A General Framework for Parameter-Efficient Fine-Tuning.

This work unify these approaches under a Triplet Matrix Decomposition framework and reveals that frequency-domain methods can surpass low-rank approaches when optimal frequency components are selected, and this advantage stems from orthogonal transformation matrices and flexible basis vector combinations.