When Muon Meets Task Interference: A Spectral Perspective on Continual Learning and Model Merging
This work reveals that the recent Muon optimizer as a mechanism that regulates this factor by construction tightens the interference bound for both CL and MM, positioning Muon as a principled optimizer-centric approach complementary to existing solutions.