Think-at-Hard: Dynamic Looped Transformers for Improved Reasoning
This work proposes Think-at-Hard (TaH), a looped transformer optimized for selective iteration that employs a lightweight neural decider to trigger latent iteration, only at tokens likely to be incorrect after the standard forward pass.