Zai-Lin Ma

Last-Iterate Convergence of Policy Dynamics in Zero-Sum Networked Separable Markov Games

The entropy-regularized optimistic multiplicative weights update (ER-OMWU), a complementary single-loop policy dynamic that updates players'policies symmetrically and returns an approximate Nash equilibria in the last iteration, is proposed.