The Sequential Price of Continual Learning
It is proved that distribution-level forgetting and population loss converge to the same stationary limit, and the additional loss incurred by sequential exact fitting, or the sequential price is quantified.
Zong-Huan Xu, Xing-Gang Ma
· 0 citations