Blog: Survey of Optimizers
This survey organizes recent optimizers and training optimization methods along four largely independent axes: temporal estimation, update geometry, horizon management, and representation and systems.
Ruo-Ran Xu
· 0 citations