Jul 2026
ROCS: Request-Oriented Compute Sharing for Efficient Large-Scale Recommendation
This work proposes Request-Oriented Compute Sharing (ROCS), a modeling and inference paradigm that exploits a unique property of recommendation inference: each user request is evaluated against many candidates, while request-side features are shared across candidates.
Yuxin Chen, Liang Luo, Buyun Zhang et al.
· arXiv.org · 0 citations