Skip to content

Author

Sakib Ul Haque

We have 1 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Preprint Aug 2026

Below the Noise Floor: Bimodal Seed Collapse and Distinct Failure Modes in Small-Model Knowledge Distillation

On a 740-instance healthcare API routing task with a 1.5B Qwen student and a 20B teacher, eight KD variants are compared against supervised cross-entropy, finding single-seed evaluation is unable to detect central failure modes in small-model KD.

Dipto Sumit, Sakib Ul Haque, Farig Sadeque · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.