Preprint
Aug 2026
AOS: Adaptive Optimizer Switching via Training-State Signals for Faster Convergence and Better Generalization
AOS-R (Adaptive Optimizer Switching, Rule-Based), a lightweight controller that monitors six online gradient-space signals and switches among AdamW, SGD-M, and Lion as the optimization landscape evolves, and achieves best accuracy on 6 of 8 combinations with a mean +0.4 pp gain.
A. K. Pandey, Umang Chaturvedi, Aatish Rana et al.
· 0 citations