Persistent Negatives for Adversarial Black-Box On-Policy Distillation
Persistent-negative adversarial distillation consistently improves performance over current methods at matched discriminator compute and yields smoother fresh-policy discriminator trajectories, with fewer below-chance dips.