#artificial intelligence
Sep 2026
Beam Search as Test-Time Self-Distillation via Counterfactual Contexts
Test-time self-distillation is proposed, a decoding-time method that extracts a steering signal from the self-distillation framework without any parameter updates, reward models, or training data, demonstrating that the self-distillation principle can be operationalized at inference time.
S. Tan, Xiao-Tong Ji, Rasul Tutunov et al.
· arXiv.org · 0 citations