Layer-wise Curriculum Learning for Efficient LLM Compression
In this paper, we introduce layer-wise curriculum learning for efficient LLM compression. The proposed method facilitates the knowledge transfer from the teacher model to the student model, utilizing a curriculum learning approach that begins with easier optimization tasks and progressively tackles harder ones. In orde...
Donggeon Lee, Dooyeon Na, Seungmin Oh et al.
· 0 citations