Reasoning with Sampling: Cutting at Decision Points
An algorithm is introduced that uses the base model's next-token entropy as a proxy to identify key decision points and resample from those positions and it is proved that the method's mixing time scales with the number of decisions in a trace rather than with the number of tokens, which can be much larger.