The swap readout is proposed, which reads each student checkpoint's feature activations on its own, measuring how training changes the student's use of each feature, even for checkpoints unseen by the crosscoder.
Zi-Chao Yu, Qian-Shuo Ye, Xu Wang et al.· 0 citations
MILD, a Motion-Preserving Image-to-Video Latent Distillation framework that transfers specialized image expertise while preserving pretrained video dynamics, is proposed and established as an effective route to improving video generation by drawing on the diverse and evolving capabilities of the image-generation ecosys...
Bing Jiang, Li Luo, Zi-Chao Yu et al.· 0 citations
SkillRubric is introduced, which represents each skill through aligned actor-facing guidance and an evaluator-facing rubric, and shows that evolved skills provide more effective guidance for planning and tool use than their preceding versions.
Bing Jiang, Guo-Xi Zhang, Jasper Wang et al.· 0 citations
TIDE (Token-level Independent Deficit-Excess correction), which applies bounded Hellinger shaping to suppress the most severe sampled excesses and an analytic teacher top-$K$ injection to restore deficient probability mass without requiring deficit tokens to be sampled, is proposed.
Zi-Chao Yu, Chengzhi Yu, Sheng-Ze Xu et al.· 4 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.