ROCS: Request-Oriented Compute Sharing for Efficient Large-Scale Recommendation
This work proposes Request-Oriented Compute Sharing (ROCS), a modeling and inference paradigm that exploits a unique property of recommendation inference: each user request is evaluated against many candidates, while request-side features are shared across candidates.