Verification-Aware Training for Speculative Decoding
Verification-Aware Training is introduced, a plug-in framework that simulates verification at every training step and turns the resulting accept and reject patterns into supervision and improves average acceptance length and wall-clock speedup across math, code, and chat benchmarks.
Geonmo Gu, Byeongho Heo, Heejae Jun et al.
· 0 citations