Author

Syed Muhammad Raza

h-index 2 View on Semantic Scholar

We have 2 of 12 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

SAD-LoRA: Spectral Alignment for Low-Rank Knowledge Distillation

SAD-LoRA is proposed (SAD-LoRA), which selects this subspace from the data-weighted student-space reference update $\DWT\Sigx^{1/2}$ and maintains it during training via a differentiable principal-angle loss on $\colspan(B)$.

Omer Tariq, Syed Muhammad Raza, J. Son · arXiv.org · 0 citations

Preprint Aug 2026

Anti-Shortcut Distillation via Temporal Negative Knowledge Transfer

A push--pull KD framework that treats the converged teacher $\Tfinal$ as a positive semantic anchor and an early-checkpoint teacher $\Tearly$ as a temporal negative reference, ASD attains the highest clean top-1 accuracy on more than 10 pairs and outperforms standard KD on 12.

Syed Muhammad Raza, Omer Tariq, J. Son · 0 citations