OmniOpt: Taxonomy, Geometry, and Benchmarking of Modern Optimizers
OmniOpt supplies the research community with an operational coordinate system for selecting optimizers under explicit mechanism and objective assumptions, and charts a direction for the future development of the optimizer community.