CPR for LLMs: Critical-Point Routing against Catastrophic Forgetting in Domain Adaptation
This work proposes CPR (Critical-Point Routing), a token-level routing framework between a base model and its expert derivative, based on critical tokens where the base model fails but the expert succeeds, and achieves state-of-the-art across all settings.
Kwangmin Ki, Yunhun Nam, Jongheon Jeong et al.
· 0 citations