Improving Inference Efficiency in Deep Neural Networks
The increasing complexity of modern deep neural networks (DNNs), particularly Transformer architectures such as large language models (LLMs) and diffusion models, has made inference efficiency a central challenge across edge and datacenter platforms. The two regimes, however, impose sharply different constraints. At th...