Next Thoughts Are Distributions: Generative Autoregressive Reasoning in the Latent Space
Autoregressive Thought Flow is introduced, which models the next continuous thought as a multimodal distribution, and suggests that continuous reasoning is more effective when multiple possible next thoughts remain available rather than being collapsed into a single prediction.
Yang Li, Yi Wang, Shinda Huang et al.
· 0 citations