Adaptive Post-Training Quantization for Transformer-Based Language Models
Large language models are difficult to deploy on limited hardware because full-precision inference requires high memory, computation, and energy. This study evaluates adaptive post-training quantization as a practical compression approach that avoids full model retraining. Two strategies are examined: SmartQuant, which...