Fast and Accurate Fisher-Guided Quantization via Efficient Kronecker Factorization
This work proposes an efficient Kronecker-factored approximation yielding state-of-the-art performance when integrated into existing quantization schemes, and substantially accelerates the most expensive component in second-order quantization – Hessian parameterization – achieving up to a 10× speedup over prior approaches.