Author

Guang-Zhong Sun

h-index 7 View on Semantic Scholar

We have 6 of 51 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Book Open access Sep 2026

BR-MoE: A Memory-Budget-Aware Co-Design Framework for Efficient MoE Inference on Resource-Constrained GPUs

BR-MoE, a memory-budget-aware co-design framework that treats per-expert bit-width and compensator rank as joint variables under a single memory constraint, establishes a superior memory–accuracy trade-off over state-of-the-art quantization methods, delivers substantial end-to-end inference speedups, and re-derives an...

Lei Jiang, Jing-Wei Sun, Jun-Qing Lin et al. · Proceedings of the Internati... · 0 citations

#large language models Book Open access Sep 2026

BR-MoE: A Memory-Budget-Aware Co-Design Framework for Efficient MoE Inference on Resource-Constrained GPUs

The Mixture-of-Experts (MoE) architecture has become the dominant paradigm for scaling Large Language Models, yet its explosive parameter growth routinely overflows the GPU memory budget. Weight quantization offers a practical way to fit these models into limited GPU memory, but reducing precision below 4 bits causes s...

Lei Jiang, Jingwei Sun, Jun-Qing Lin et al. · Proceedings of the Internati... · 0 citations

2025

Lua-LLM: Learning Unstructured-Sparsity Allocation for Large Language Models

Lua-LLM is proposed, a learning-based global pruning framework that explores the optimal unstructured sparsity allocation and achieves flexible allocation for both layer-wise and intra-layer sparsity.

Ming Lu, Jing-Wei Sun, Jun-Qing Lin et al. · Neural Information Processin... · 1 citation

Preprint Aug 2026

FlashQuant: Sparse-Dense Fusion for Memory-Efficient Outlier-Aware LLM Inference

FlashQuant fuses the dense GEMM and sparse outlier SpMM paths into a single GPU kernel, enabling on-chip reuse of activation and output tiles across heterogeneous computations, and introduces three key techniques: sparse-dense tiling, which aligns outlier processing with dense GEMM tiles, and pipelined scheduling, whic...

Jun-Qing Lin, Jing-Wei Sun, Zhengding Hu et al. · 0 citations

Preprint Aug 2026

DeltaLog: Deferred Materialization of Recurrent States for Linear Attention Decoding

DeltaLog is presented, a recurrent-state decoding scheme that reduces this overhead without changing the model semantics, and is implemented for GDN, KDA, and RWKV6 and integrated into a prototype serving stack.

Jun-Qing Lin, Jing-Wei Sun, Guang-Zhong Sun · 1 citation

Preprint Jul 2026

EMO: Energy Efficiency Modeling and Optimization for AI Workloads

EMO combines graph analysis and pack-level models to formulate energy optimization as a constrained combinatorial problem, efficiently solving for optimal frequency policies under given latency targets.

Jiyu Luo, Shaoyu Chen, Jingwei Sun et al. · 0 citations