Preprint
Aug 2026
SoftWater: Class-Aware Rate Allocation for Softmax Quantization
Across five models from 1B to 32B, SoftWater outperforms the released WaterSIC quantizer at matched head rates on 59 of 60 test points, using none of that pipeline's refinements and cutting head-induced KL by $6.5\times$--$8.3\times at 2 bits.
Joao V. Cavalcanti, Ashia C. Wilson
· 0 citations