Learning a Single Token to Replace Long System Prompts in LLMs
A lightweight training framework that learns a single Behavior-Equivalent Token that substantially reduces inference cost and frees nearly the entire context window for user inputs and model outputs.
Jiancheng Dong, Pengyue Jia, Jingyu Peng et al.
· 2 citations