Approximate machine unlearning seeks to remove the influence of a forget set from a trained model without full retraining. Existing gradient-based methods require data-dependent hyperparameter search, struggle when forget and retain knowledge are entangled, and offer little insight into where unlearning actually happen...
Hao-Ran Tang, Andrew Tan, Rajiv Khanna· 0 citations
Machine learning systems increasingly face the need to remove the influence of entire data domains, such as toxic language, harmful behavior, or topical content, rather than isolated records. Recent work formalizes this problem as \emph{distributional unlearning}: selecting a subset of a forget domain whose removal mov...
P. Mohanty, Hao-Ran Tang, Maggie Makar et al.· 0 citations
Normalization renders large parts of neural networks effectively scale invariant, inducing a hidden feedback loop in which learning-rate schedules and weight decay interact through the parameter norm to control the effective step taken by the optimizer. We show that this interaction is governed by an exact discrete-tim...
H. Amin, Wei-Kai Chang, Rajiv Khanna· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.