Auditing Information Disclosure During Large-Scale Gradient-Based Training via Gradient Uniqueness
This work proposes a principled, attack-agnostic approach that uses mutual information to measure what the final model reveals about a datapoint's training membership and shows that this final-model disclosure is upper bounded by the sum of per-iteration gradient disclosures.