Valentina K. Petrakis

Convergence Rate Bounds for Stochastic Gradient Descent With Adaptive Step Sizes on Non-Convex Loss Surfaces

This study investigates convergence rate bounds for stochastic gradient descent with adaptive step-size schedules on non-convex loss surfaces within the context of mathematical optimization theory and machine learning theory, an area of growing scientific importance given its implications for training efficiency of lar...