Characterizing the role of reasoning tokens in large language models as state over tokens
The State over Tokens (SoT) conceptual framework is introduced, which reframes reasoning tokens not as a linguistic narrative, but as an externalized computational state—the mechanism that persists the computation across the separate generation cycles.