Orthogonal Updates for the Win: Towards Accelerated Adaptive Minimax Optimization
An orthogonal update framework tailored to minimax optimization, which equips orthogonal updates with an adaptive stepsize rule driven by accumulated gradient norms, yielding an effectively parameter-free method for nonconvex-strongly-concave minimax optimization.