Decoupled Contrastive Decoding is introduced, which drafts with an expert-aligned lightweight proposer and applies the amateur only in unchanged CD verification and achieves average greedy speedups of 1.65 to 1.95x over vanilla CD and reduces MMLU proposal-path latency by about 5 to 12x relative to amateur-coupled prop...
Zhi-Xuan Liu, Zhichen Dong, Yuanfu Wang et al.· 0 citations
Scaling model-generated data is usually viewed as improving distillation: more examples should increase coverage, reduce noise, and produce stronger students. We show a second effect: larger datasets can make subtle teacher-specific signals easier to detect in the trained student, even when examples are off-task and ne...
Zhichen Dong, Zhi-Xuan Liu, Yuanjiu Fan, et al.· 1 citation
Trait-direction drift is proposed and validated as a mechanism for subliminal learning: biased generation creates measurable preference gaps in teacher data, and student-recognizable gaps induce trait-aligned updates during supervised fine-tuning that accumulate into behavioral transfer.
Zhi-Xuan Liu, Zhichen Dong, Yuanjiu Fan, et al.· 1 citation
A semantic-entropy-based method, using task uncertainty to guide prompt optimization, which requires no training, works with black-box models, and integrates easily into existing prompt optimizers.
Shuyang Zhang, Zhixuan Liu, Zhichen Dong et al.· Annual Meeting of the Associ...· 2 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.