Xuan-Wu Yin

SliMOO: Interpretable Multi-Objective Evolutionary Search for LLM Depth Pruning

As large language models (LLMs) grow more powerful, their scale makes them costly to serve. Depth pruning offers a practical route to efficiency by directly reducing memory and latency without hardware-specific support. However, we observe that transformer layers exhibit markedly different task-dependent layer contribu...