A series of models are explored that connect item Semantic IDs with natural language in a unified representation space and seek to unlock the potential of natural-language chain-of-thought (CoT) reasoning for recommendation, including OneReason.
Jiang-Xia Cao, Hao Peng, Wen-Long Xu et al.· 0 citations
Specializing large language models to vertical domains improves domain-specific behavior but often degrades general capabilities. We study this trade-off in Multi-Teacher On-Policy Distillation (MOPD), where a specialized model learns from domain and general teachers on its own sampled trajectories. Standard MOPD faces...
Zi-Yuan Liu, Jiao Ou, Jian Liang et al.· 0 citations
Results show that generative retrieval can combine shared modeling with objective-specific control and complementary candidate generation, and under the same 512-item retrieval budget, Multi-Decoder OneRec improves over the single-decoder OneRec baseline.
Counteraction-Aware Multi-Teacher On-Policy Distillation is proposed, which addresses issues with decoupled alternating training and gap-based sample selection and outperforms all baselines in general capability recovery while maintaining domain-specific behavior.
Tian-Le Chen, Jiao Ou, Zi-Yuan Liu et al.· arXiv.org· 13 citations· ⚡1
A consistency boundary analysis is presented that characterizes when diagonal short-memory SSMs can approximate causal attention and identifies structural gaps that remain and proposes InfoMamba, an attention-free hybrid architecture that consistently outperforms strong Transformer and SSM baselines.
Youjin Wang, Jiaqi Zhao, Rong Fu et al.· arXiv.org· 0 citations
WhisperRec compresses teacher-generated CoT into learnable latent reasoning tokens, enabling a Latent-Reason-then-Answer paradigm that performs reasoning in latent space without producing verbose rationales, and achieves over 10x higher online inference throughput.
Hao Jiang, Pei Du, Pengfei Yao et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.