INTACT: Inducing Latent Reasoning on a Frozen Backbone
Latent reasoning replaces natural-language chains of thought with compact continuous"soft-token"representations, reducing the number of intermediate tokens that must be decoded autoregressively. We use a small external encoder to induce latent reasoning in a frozen backbone model. The encoder iteratively maps the backb...