Generalized Agent Iteration: One Formal Framework for Iterative Policy Improvement and Recursive Self-Improvement
This paper proposes Generalized Agent Iteration (GAI), a formal framework that describes iterative policy improvement and RSI as two cases of a single learning paradigm that rests on the classical account, makes existing systems comparable, and provides a principled basis for analyzing and designing new ones.