MAdam: MLMC Adam under Markovian Noise with Application to Average-Reward Policy Optimization
An algorithm MAdam is proposed, extending classical Adam for average-reward RL, providing the theoretical analysis for non-convex optimization problems and conducting experiments on challenging environments, indicating the qualitative performance of the approach.