$O(1/n)$ Convergence Rate for RVI $Q$-Learning
Finite-time convergence guarantee for synchronous relative value iteration (RVI) $Q-learning for finite weakly communicating Markov decision processes (MDPs) is established and linear regularity and the noise condition for the centered Bellman operator for finite weakly communicating MDPs are verified.