Understanding and Enforcing Weight Disentanglement in Task Arithmetic
This paper first proves that TFS is a sufficient condition for weight disentanglement, and finds that TFS also gives rise to an observable geometric consequence: weight vector orthogonality, which positions TFS as the common cause for both the desired functional outcome and a measurable geometric property.