Preprint
Jul 2026
Do Uncertainty Signals Help? A Systematic Study of Uncertainty-Aware Decoding with Rollback Mechanisms
This work studies uncertainty-aware rollback decoding, an inference-time strategy that uses uncertainty signals to identify unreliable generation regions and roll back to earlier valid prefixes without retraining the model.
Xianzong Wu, Xiaohong Li, Yue-Jun Guo et al.
· 0 citations