Yonathan Efroni

Frustratingly Simple Black-Box Adaptation of Language Models via Logit Bias

This work develops a black-box method for learning a single context-independent logit-bias vector, added at every decoding step, without modifying model weights or requiring gradients, and suggests that learned logit bias is a lightweight mechanism for adapting language models under minimal access requirements.