Dimitris Oikonomou

Curvature-Scaled Sharpness-Aware Minimization: Convergence Beyond Smoothness

Sharpness-Aware Minimization (SAM) has established itself as a widely used method for training deep neural networks. Despite its popularity, existing convergence guarantees for SAM-type methods require smoothness, a restrictive assumption. Generalized smoothness conditions have recently been proposed in the analysis of...