Preprint
Aug 2026
AWARe: Mitigating Catastrophic Forgetting via Activation-Weighted Adaptive REtention
Activation-Weighted Adaptive REtention (AWARe) is a fine-tuning method that mitigates catastrophic forgetting by dynamically controlling parameter updates based on activation patterns, and operates without modifying model architectures, ensuring compatibility with existing inference engines.
Jun-Yong Liao, Jinfan Lv, Guoming Wang et al.
· 0 citations