Jul 2026
MXSens: Sensitivity-Aware Mixed-Precision Quantization for Efficient LLM Inference
This work introduces MXSens, a training-free method that assigns mixed mantissa bitwidths (4/6/8) based on column- and layer-wise sensitivity, naturally leveraging the block-wise structure of MXINT, and establishes a new balance between accuracy and resource efficiency for LLM quantization.
Simla Burcu Harma, D. Mishin, Zheng-Yuan Su et al.
· arXiv.org · 1 citation