#artificial intelligence
Sep 2026
iSDFT: Information-Proximal Self-Distillation for Continual Learning in LLMs
Controling how much and when teacher information is introduced improves specialisation while preserving broader capability is shown, and results show that controlling how much and when teacher information is introduced improves specialisation while preserving broader capability.
Ahmed Khaled Khamis, Xiao-Tong Ji, Hassan Jaber et al.
· arXiv.org · 1 citation