CARD: Closing the Teacher-Student Loop for Adversarial Robustness Distillation
Adversarial robustness distillation typically treats a robust teacher as a fixed knowledge source and transfers robustness to a compact student in a one-way manner. This paradigm terminates teacher-student interaction once the student is distilled, thereby discarding potentially useful feedback from the distilled stude...
Zhi Li, Hao Liu, Hong-Chen Yang et al.
· 0 citations