Liu O. Martin

Extracting Small Translation Specialists from LLMs by Aggressively Pruning Experts

This paper presents a method for aggressively pruning experts from modern mixture-of-experts LLMs while incurring negligible degradation in translation quality, and shows that translation requires only a fraction of the LLM, enabling substantial compression of the MoE blocks that contain over 90% of parameters.