Softmax Reparameterization for Output-Head Quantization
This work introduces softmax reparameterization, a post-training method that searches over functionally equivalent output heads before quantization and shows how fidelity can improve despite greater total logit error.
Asim Kadav, Christian Flores, C. Arora et al.
· 1 citation