Beyond End-to-End: A Low-Latency, Retrieval-Augmented Chain-of-Thought for Scalable and Explainable Industrial Recommendation
Large Language Models (LLMs) can provide semantic reasoning for recommendation, but direct LLM invocation is incompatible with the latency, stability, and reliability requirements of industrial ranking systems. We propose RA-CoT (Retrieval-Augmented Chain-of-Thought), a deployment-oriented framework that uses LLM-deriv...