Preprint
Aug 2026
IDeaL: Data-Free Multi-Teacher Distillation via Improved Dead Leaves
It is shown that information contained in the teachers can be leveraged to tailor the noise for multi-teacher distillation, and a method is proposed that generates teacher-specific, improved samples optimized for data-free distillation.
Feyza Yavuz, Mert Bulent Sariyildiz, Diane Larlus
· 0 citations