The KSA V2 is developed, which not only achieves a more flexible KV cache memory compression but also reduces the computation cost in Full attention layer and finds that the summary tokens can serve two roles: the KV memory and sparse indexer.
OneRec Team Chenglong Chu, Guo-Hong Mu, Guo-Wang Zhang et al.· 0 citations
This work introduces EvoSkillRec, a promotion-and-reuse framework for cumulative recommender architecture evolution that decomposes recommenders into atomic executable skills and represents architectures as typed skill genomes, with each skill equipped with input--output types, semantic annotations, and implementation...
Xiao-Peng Li, Kuo Cai, Bo Chen et al.· arXiv.org· 1 citation
WhisperRec compresses teacher-generated CoT into learnable latent reasoning tokens, enabling a Latent-Reason-then-Answer paradigm that performs reasoning in latent space without producing verbose rationales, and achieves over 10x higher online inference throughput.
Hao Jiang, Pei Du, Pengfei Yao et al.· arXiv.org· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.