Quantization-Aware Healing: A Practical Recipe for Recovering Compressed, 4-Bit LLMs
The aim is a recipe deployable without a multi-week hyper-parameter search, which distills the 4-bit student directly from the original, uncompressed model, and is released open-weight as Hypernova-60B.