M. Mozer

Recirculation

This work describes an inference-time architectural enhancement for off-the-shelf foundation models that markedly reduces perplexity and boosts accuracy across generation and reasoning tasks, and proposes and evaluates an adaptive variant of recirculation which requires only light tuning of hyperparameters while freezi...