Learning to Remember: How Early Data Exposure Protects Post-Trained Capabilities from Catastrophic Forgetting
It is found that immediate post-training performance does not reliably predict retention after subsequent fine-tuning, and this supports the view that post-training drives immediate specialization while early exposure improves robustness to later forgetting.
Lawrence Feng, Aditi Raghunathan
· 0 citations