Skip to content
Book Open access

GUIDER: Generative User Interest Discovery via Explicit Reasoning with Large Language Models

Aug 2026 · Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · pp. 8246-8257 · 0 citations · 33 references

Abstract

The emergence of Large Language Models (LLMs) has driven a paradigm shift in sequential recommendation from discriminative ranking to generative modeling. However, existing generative approaches predominantly rely on semantic IDs (SIDs)—discrete identifiers derived from hierarchical quantization that function as semantic black boxes. Solely designed for in-domain reconstruction, these opaque tokens preclude the mining of explicit user behavioral logic. In contrast, plain-text modeling unlocks the full inferential potential of LLMs, enabling superior generalization and precise, logic-driven interest discovery. To bridge this gap, we propose GUIDER (Generative User Interest Discovery & Explicit Reasoning), a framework that fundamentally decouples intent planning from item matching by reformulating sequential modeling within a rigorous closed-set semantic interest space. GUIDER first internalizes domain-specific semantics via continual pre-training and activates explicit reasoning through a hindsight-guided chain-of-thought strategy. Crucially, to ensure precise optimization of the generated interest set, we introduce Token-Adaptive Policy Optimization (TAPO). Addressing the credit assignment problem—where standard reinforcement learning indiscriminately assigns identical advantages to the entire response regardless of local correctness—TAPO employs a token-level advantage adaptation mechanism. This strategy explicitly differentiates valid interest circles from hallucinations by dynamically redistributing advantages based on fine-grained quality, while a dynamic thinking penalty suppresses redundant reasoning. Extensive offline evaluations and large-scale online A/B testing on the Kuaishou platform validate that GUIDER not only achieves superior accuracy but also yields consistent gains in average app duration and effectively facilitates out-of-cocoon interest exploration.

Read PDF

Similar papers

Jul 2026

WhisperRec: Latent Reasoning for Efficient Foundation Recommendation Models

WhisperRec compresses teacher-generated CoT into learnable latent reasoning tokens, enabling a Latent-Reason-then-Answer paradigm that performs reasoning in latent space without producing verbose rationales, and achieves over 10x higher online inference throughput.

Hao Jiang, Pei Du, Pengfei Yao et al. · 0 citations
Jul 2026

From Understanding to Action: Feedback-Grounded Policy Discovery for Generative Recommendation

Semantic-ID-based generative recommenders enable efficient next-item generation, but their item-level supervision mainly captures behavioral co-occurrence and local transitions. Large language models (LLMs) can complement these models by reasoning over heterogeneous interaction histories to understand the user's current demand. However, LLMs are not inherently trained with recommendation-specific outcome feedback, and linguistically plausible reasoning therefore does not necessarily lead to effective recommendation decisions. We term this mismatch the Understanding-Action Gap. Accordingly, we distinguish intent knowledge, which captures the user's current demand, from policy knowledge, which specifies the recommendation direction and rejection boundary under that demand. To bridge this gap, we propose a feedback-driven agent framework that first induces task-oriented intent and then discovers recommendation policies according to their incremental utility over an intent-only baseline. Candidate policies are evaluated and refined using outcome-derived feedback rather than linguistic plausibility. We further transfer the resulting intent and policy knowledge into two latent tokens of a lightweight Semantic-ID generator through dual-space relational distillation, enabling LLM-free online inference. Experiments on public benchmarks show consistent improvements over baselines, while large-scale online A/B tests achieve gains of 4.506% in Revenue and 4.621% in ADVV.

Z. Chen, Minmao Wang, Xingchen Liu et al. · 0 citations
Book Open access Jul 2026

Reasoning-Grounded Intent Injection for Generative Recommendation

Industrial generative recommendation systems operating over discrete Semantic IDs (SIDs) are largely behavior-driven, and thus struggle to proactively activate latent demand before explicit user signals emerge, leading to intent cold-start. To address this, we propose RIGER (Reasoning-grounded Intent injection for GE nerative Recommendation), a deployable two-stage framework that integrates offline large language model (LLM) reasoning into an online generative recommender under strict latency constraints. Offline, to ensure scalable deployment, we distill the latent-intent inference capability of a strong LLM into a lightweight forecasting model using an automated data curation pipeline---leveraging judge-guided prompt calibration and future-query-guided rejection filtering. Online, to bridge the representation mismatch between free-form textual intents and the discrete SID token space, predicted intents are converted into SID-native tokens through a behavior-grounded mapping and injected into the deployed decoder-only retrieval backbone. We further fine-tune the model with beam-aware GRPO, introducing a hierarchical intent-alignment exploration reward in SID space while preserving exploitation behavior through KL regularization. Offline evaluations demonstrate a substantial increase in intent-aligned density and diversity with only a marginal reduction in hindsight recall, indicating that RIGER effectively enhances proactive intent exploration while preserving its capability to exploit historical behaviors. In a large-scale e-commerce display advertising system, RIGER improves clicks by 1.6% and advertiser spend by 1.3%.

Xusong Chen, Peini Guo, Fang Liu et al. · 0 citations
Book Open access Aug 2026

From Retrieval to Reasoning: Building Language-Steerable Discovery Systems at Spotify

For decades, search and recommendation systems have been optimized as distinct components within large-scale discovery platforms. The rise of generative AI is beginning to blur this boundary. At Spotify, we are exploring how large language models can evolve from tools that retrieve content into systems that reason over users, catalogs, and intent, while remaining steerable through natural language and user interaction. This talk presents lessons from deploying and studying generative retrieval and recommendation systems across Spotify's content ecosystem. I will describe how semantic identifiers enable language models to operate directly over large, heterogeneous catalogs, allowing search, recommendation, retrieval, explanation, and user understanding to be expressed within a common generative framework. I will discuss recent work on production-scale podcast discovery, language-steerable recommendation, and the NEO framework for unifying search, recommendation, and reasoning across multiple content types. These systems demonstrate how grounding language models in catalog entities and user behavior can improve discovery while preserving the flexibility of natural-language interaction. More broadly, they suggest a path toward discovery systems in which retrieval, recommendation, and reasoning are no longer separate stages, but capabilities of a shared generative model. Beyond model frameworks, I will discuss the emerging challenges of alignment and evaluation in discovery systems. Unlike traditional retrieval problems, generative recommendation often has many valid answers. I will present approaches for learning from large-scale behavioral signals, preference-aware optimization, and profile-aware LLM-as-a-judge evaluation, along with lessons from online experimentation at Spotify. These experiences suggest that future discovery systems will require new forms of personalization, controllability, and evaluation that extend beyond conventional ranking metrics. I will conclude with a research agenda for generative discovery systems, including language-steerable interfaces, unified retrieval-and-reasoning models, preference-aligned generation, and evaluation frameworks designed to measure user-specific relevance at scale. As search, recommendation, and conversational AI continue to converge, these directions point toward a new generation of discovery systems that can understand intent, reason over large catalogs, and help users navigate increasingly complex information spaces.

Paul N. Bennett · 0 citations
Jul 2026

CogRec: Structure-Cognitive Fast-and-Slow Reasoning for Generative Recommendation

Experiments on three public sequential-recommendation benchmarks show that SID Routing improves its corresponding direct-generation, and indicate that structure-grounded reasoning is most useful when prefix matching is insufficient but learnable SID-space transitions remain available, whereas long or weakly supported routes introduce additional decoding cost and accumulated errors.

Xiangyan Liu, Jingsong Su, Shuqing Zhao et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.