Skip to content

Author

Taylor W. Killian

We have 5 of 14 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

REVO: Rollout-Efficient Off-Policy Distillation via Variance-Guided Reuse

On-policy distillation (OPD) trains language models using dense token-level teacher supervision on student-generated trajectories. However, its reliance on frequently refreshed student rollouts often incurs substantial generation cost. We introduce REVO, an off-policy distillation framework that improves rollout effici...

Yu-Xiao Yang, Shang-Zhe Li, Tian-Run Yu et al. · 0 citations

Rethinking Training-Inference Mismatch in LLM Reinforcement Learning: Where It Arises and How to Correct It

CIS replaces the unbounded second moment that governs the error of exact importance sampling with a term bounded by a constant, at the cost of a bias controlled by the truncated excess, in evaluation across three mixture-of-experts models and five mathematical reasoning benchmarks.

Tian-Run Yu, Kai-Xiang Zhao, Shang-Zhe Li et al. · 1 citation
#machine learning Preprint Dec 2025

K2-V2: A 360-Open, Reasoning-Enhanced LLM

K2-V2 is introduced, a 360-open LLM built from scratch as a superior base for reasoning adaptation, in addition to functions such as conversation and knowledge retrieval from general LLMs, to empower the community with a capable, reasoning-centric foundation.

K2 Team Zhengzhong Liu, Liping Tang, Ling-Hao Jin et al. · 0 citations
#machine learning Preprint Sep 2026

When EOS Tokens Disagree: Understanding Length Inflation in On-Policy Distillation

We study length inflation in on-policy distillation (OPD), where student responses can become excessively long and even exhaust the generation budget. We identify \emph{termination-token mismatch} between base students and post-trained teachers as an important source of this behavior. Across Qwen3, Llama, and Gemma, th...

Yu-Xiao Yang, Tian-Run Yu, Shang-Zhe Li et al. · 4 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.