Preprint
Oct 2026
LOOP: Recovery-Aligned Iterative Layer Pruning via On-Policy Distillation
Layer-level pruning is attractive for large language model (LLM) deployment as it reduces the model size while preserving a dense architecture that can be efficiently executed on standard hardware. Current methods typically follow a one-shot paradigm, which first removes selected layers to reach a target model size and...
Liang-Sheng Xu, Shu-Fan Shen, Zhong-Ni Hou et al.
· 0 citations