Stefan Stojanovic

Shift Before You Learn: Enabling Low-Rank Representations in Reinforcement Learning

This work demonstrates that a low-rank structure naturally emerges in the shifted successor measure, which captures the system dynamics after bypassing a few initial transitions, and establishes a connection between the necessary shift and the local mixing properties of the underlying dynamical system, which provides a natural way of selecting the shift.