Idil Gözel

Learning Suffers More Than the Policy Class Under Partial Observability: A Closed-Form Analysis

When a reinforcement learning agent cannot observe the full state, we usually blame its policies: it cannot see enough to represent a good one. We show that in a solvable case the bigger problem lies elsewhere. Even when a good policy is available and the agent's value function is expressive enough to describe it exact...