Latent reasoning replaces natural-language chains of thought with compact continuous"soft-token"representations, reducing the number of intermediate tokens that must be decoded autoregressively. We use a small external encoder to induce latent reasoning in a frozen backbone model. The encoder iteratively maps the backb...
Kutay Tire, Atula Tejaswi, Haris Vikalo et al.· 0 citations
Complex reasoning queries can be decomposed into directed acyclic task graphs and distributed across heterogeneous LLMs, reducing latency through parallelism and enabling smaller models to solve complex tasks. In practice, however, the suitability of an LLM for a given subtask may be a priori unknown, and execution alo...
Hao-Ran Zhang, Dongjun Kim, Seohyeon Cha et al.· 0 citations
This work introduces TWISTER, the first automaton-twisted Sequential Monte Carlo decoder for MDLMs, and proves that for regular language constraints, the Feynman-Kac correction is exactly computable, with the twists obtained efficiently using quantities pre-computed for step-exact sampling.
Aditya Thimmaiah, Lara Marinov, Jayanth Srinivasa et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.