Skip to content

Author

Pang Wei Koh

We have 2 of 17 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#small language model Preprint Oct 2026

Rubric-Based Optimization for Text-to-Music Generation

Together, these results suggest a practical division of labor: ALM rubrics are effective for broad perceptual qualities that are difficult to formalize, while specialized objective rewards remain preferable when reliable measurements are available.

Ping Wang, Guang Yang, Shao-Rong Su et al. · 0 citations
#natural language process... Preprint Sep 2026

Knowledge Distillation During Mid-Training Favors Reasoning over Factual Recall

Switch Distillation is proposed, a simple mid-training objective that distills on tokens where the teacher is confident, using teacher predictive entropy as a lightweight routing signal, and otherwise falls back to cross-entropy, which consistently outperforms existing distillation objectives across teacher sizes.

Jacqueline He, Howard Yen, S. Li et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.