Xudong Zhu

One Token Can Be Enough: Bridging Prompting and Activation Steering with Prefix Steering

Prompting guides language model behavior through the initial context, whereas activation steering often intervenes throughout generation. A natural question is whether steering can produce effects on subsequent computation similar to those of prompting. Under fixed-state attention assumptions, we establish sufficient c...