A training-free PTQ framework for ARVG, consisting of Tail-Aware Bounded-init Grid Refinement (T-BGR) and Coarse-to-Fine Activation Precision Scheduling (CAPS), which achieves near full-precision image generation quality at an effective W4A5.6 activation precision.
Xin-Meng Liu, Xiang-Long Yan, Kai-Cheng Yang et al.· 0 citations
Extreme low-bit weight-only quantization is an effective approach to reducing the deployment costs of large language models. Below 3 bits, scalar quantization often suffers severe accuracy loss, while vector quantization (VQ) better preserves accuracy through more expressive joint encoding. However, existing VQ methods...
Xiang-Long Yan, Ze-Nan Wu, Ke-Wei Zhang et al.· 0 citations
JustQuant is proposed, a simple yet effective framework that moves the complexity of low-bit quantization from deployment-time operators into the training process and introduces Theseus QAD, a quantization-aware distillation method that progressively applies multi-level supervision, analogous to the gradual replacement...
Kai-Cheng Yang, Kai-Sen Yang, Chun-Yu Liu et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.