Attention Routing Stabilizes Early: Working-Set Inference for Recurrent Language Models
This work introduces WISE (Working-set Inference with Support Exploitation), a training-free method that uses unrestricted attention during early recurrent steps to discover a block-structured working set, then reuses its support in later steps while keeping attention weights and recurrent refinement dynamic.