Hidden States as Value Gradients: The Pontryagin Structure of Recurrent Policies
This work shows that the hidden state of a recurrent policy admits a control-theoretic interpretation: it plays the role of the co-state in Pontryagin's minimum principle, and the readout that maps it to actions implements control-Hamiltonian minimization.
D. Leeftink, Max Hinne, M. V. van Gerven
· 0 citations