Direct Search Methods for Online Nonconvex Optimization Under Inexact Bandit Feedback
A randomized two-point direct-search algorithm for nonconvex time-varying optimization and derive iteration-complexity bounds under both constant and diminishing probing ratios, which recover the complexity of existing zeroth-order methods in the time-invariant setting while extending direct- search methods beyond static settings.