Sufficiency of Zeroth-Order Reward Shaping for Policy Gradient in Stabilization Control
This work theoretically and empirically demonstrate that policy gradient methods can successfully solve stabilization tasks without first-order reward terms, and confirms that reward functions must be zeroth-order complete over goal-relevant coordinates, while the first-order state remains necessary in the policy obser...