Preprint
Aug 2026
Hierarchical Latent Prediction for Language Models
Hierarchical Latent Prediction (HiLP) is introduced, which introduces an auxiliary higher-level abstract latent to help reduce the error accumulation effect in latent-space rollouts and can lead to longer-horizon coherent belief state representation.
Changyan Shi, Tim Pearce, Manan Tomar et al.
· 0 citations