Summary-token architectures such as Kwai Summary Attention (KSA) compress distant context into learnable Summary token per chunk, and hybrid variants interleave these layers with full attention to retain exact access to the original text. In such hybrid KSA-Full architecture, the interleaving inserted summary tokens ar...
OneRec Team, Chenglong Chu, Guo-Hong Mu et al.· 0 citations
A series of models are explored that connect item Semantic IDs with natural language in a unified representation space and seek to unlock the potential of natural-language chain-of-thought (CoT) reasoning for recommendation, including OneReason.
Jiang-Xia Cao, Hao Peng, Wen-Long Xu et al.· 0 citations
Value-guided decoding is proposed, named RGD, a controllable decoding framework for industrial value-oriented generative recommendation that deriving a closed-form reward guided decoding distribution that principledly combines generation probability with reward signals.
These findings establish articulated rationales as a useful complement to behavioral and content signals, and demonstrate a practical role for MLLMs in scaling sparse human explanations into preference information that improves industrial recommendation.
Hao-Ke Xiao, Yue-Yang Liu, Yu-Hui Zhang et al.· 0 citations
This work proposes UniR, a decoder-only Transformer that unifies Generative and Multi-Objective ranking within a single heterogeneous sequence comprising user context, SID trajectory, and item features, validating the practicality of unified model in large-scale recommendation systems.
These results show that RecoReward trains the MLLM to produce item features that benefit downstream recommendation while retaining content-only serving, and shows that RecoReward-9B outperforms its Qwen3.5-9B baseline and all other evaluated models across seven recall metrics.
Guohong Mu, Yue-Yang Liu, Jiangxia Cao et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.