Skip to content

Author

Ali Hashemi

We have 2 of 7 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

Quantization-Aware Healing: A Practical Recipe for Recovering Compressed, 4-Bit LLMs

The aim is a recipe deployable without a multi-week hyper-parameter search, which distills the 4-bit student directly from the original, uncompressed model, and is released open-weight as Hypernova-60B.

Bakbergen Ryskulov, Iker García-Ferrero, David Montero et al. · 0 citations
Preprint Aug 2026

Efficient Knowledge Distillation for LLMs: Offline Top-K Logits and a Fused Chunked KL Loss

A practitioner's study of how to make distillation training efficient is presented, organised around two systems contributions, and a fused, chunked KL loss is introduced, making peak memory linear in the sequence length.

Bakbergen Ryskulov, Iker García-Ferrero, David Montero et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.