Sholpan Bolatzhanova

Selective Transfer through Sequence Distillation: From Benchmark Knowledge to Backdoor Behaviour

Knowledge distillation is widely used to transfer capabilities from teacher models to student models, but recent work shows that it can also transfer unintended teacher properties. We study whether different hidden teacher properties survive the same distillation channels. Specifically, we compare two properties: bench...