Correlation-Aware Structured Pruning for Large Language Models
Structured pruning is a promising approach for reducing the substantial inference costs of Large Language Models (LLMs) while maintaining hardware efficiency. Many existing methods assess the importance of prunable units (e.g., channels or heads) in isolation, implicitly assuming that pruning errors are additive. This...
Si-Cheng Xu, Hao Shi, Wei Zhang et al.
· 0 citations