SAPD: Learning from Agent Experience without Environment Interaction
Step-Advantage Policy Distillation (SAPD) is proposed, a method for learning from offline trajectories using relative step advantages, allowing the student to generate responses conditioned on recorded histories, and introduces relative step advantage signals to stabilize training.
Jun-Cheng Diao, Hai-Bin Wang, Wei Shi et al.
· 0 citations