Value-Aware Estimation of Diffusion Systems for Continuous-Time Reinforcement Learning: Surrogate Loss and Financial Applications
Abstract. We estimate diffusion systems modeled by SDEs to solve optimal control problems in a continuous-time model-based reinforcement learning framework. Instead of minimizing a statistical loss, we estimate models by reducing the mismatch between the model-based value process and empirical rewards under a given pol...