Skip to content

Author

Swati Dhiman

We have 1 of 1 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Aug 2026

Which Decisions Low-Bit Quantization Breaks, and How to Predict Them

This work tracks quantization across 16 models from 8 families under round-to-nearest, seven under AWQ, two under GPTQ and one under GGUF, at 8 down to 2 bits, and measures the margin, the picked option's score minus its best alternative's, which removes the protection a large margin affords.

Zekun Wu, Swati Dhiman, A. Koshiyama · 1 citation

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.