Weightless Fine-Tuning: Personalizing LLMs via Logit-Space Transport
Weightless Fine-Tuning is proposed, a training-free decoding-time method that approximates the distributional effect of SFT without weight updates and achieves the best average performance across datasets, matches or exceeds SFT on individual tasks, and outperforms other lightweight baselines on average.