Recommendation systems increasingly adopt a two-stage pipeline, where an ID-based retriever retrieves candidates and an LLM-based reranker refines their rankings. To improve retrieval quality, reranker-to-retriever distillation is commonly used to transfer the reranker's knowledge to the retriever. For practical deployment, however, this pipeline must continually adapt to evolving interests and incoming interactions. A naive solution is to repeatedly update the LLM reranker and distill its latest knowledge, but this incurs prohibitive costs. Updating the retriever alone is cheaper, but its limited capacity makes adaptation from sparse data difficult. We propose SCoRD, a continual knowledge distillation framework for LLM-based reranking pipelines under a non-stationary data stream. SCoRD introduces a semantic reasoning assistant that distills the LLM's ability to infer underlying user intents into reusable intent-level guidance. It selectively distills reranker knowledge to the retriever on low-confidence sequences, guides retriever-only updates without repeated LLM inference, and feeds retriever-derived representations and intent-drift signals back to the reranker. Experiments on real-world datasets show that SCoRD enables effective and efficient retriever-reranker co-adaptation.
S. Baek, Gyuseok Lee, Seunghan Lee et al.· 0 citations
Large language models (LLMs) have transformed AI, yet they remain fundamentally limited by hallucination, unverifiable reasoning, and shallow evidence grounding. We argue that structure mining-rooted in decades of KDD research on taxonomy induction, ontology design, entity typing, and knowledge graph construction-is the key to overcoming these limitations. This tutorial presents a unified vision in which structuring serves as the enabling foundation for three pillars of next-generation LLM systems: (1) Structured Retrieval, where organizing corpora into ontology-guided multidimensional representations enables SQL-like queries that achieve substantially more precise and complete retrieval than similarity-based approaches; (2) Structured Reasoning, where grounding each inference step in typed, graph-structured evidence transforms opaque generation into auditable, verifiable reasoning chains; and (3) Structured Agent Memory, where multi-dimensional memory architectures bridge external corpus knowledge and experiential agent knowledge through a mutually enriching dual-memory design. Across all three pillars, we highlight how the cooperative interplay between classical KDD techniques and modern LLMs-where KDD defines structural schemas and quality constraints while LLMs execute flexible extraction and reasoning-creates systems that are more reliable, interpretable, and faithful. The tutorial covers both foundational methods and the latest advances (2024--2026), and concludes with open problems and future research directions at the intersection of data mining and LLMs.
Pengcheng Jiang, Jiashuo Sun, Wonbin Kweon et al.· Proceedings of the 32nd ACM...· 0 citations
A model-agnostic framework that forms personalized item embeddings through Long-Horizon Local Optimization and injects common global knowledge through intermittent Regularized Knowledge Guidance is proposed and Adaptive Guidance is introduced to control the influence of global knowledge at the user–item interaction level.
Jaehyung Lim, Wonbin Kweon, Woojoo Kim et al.· Journal of Intelligence and...· 0 citations
This tutorial presents a unified vision in which structuring serves as the enabling foundation for three pillars of next-generation LLM systems, highlighting how the cooperative interplay between classical KDD techniques and modern LLMs-where KDD defines structural schemas and quality constraints while LLMs execute flexible extraction and reasoning-creates systems that are more reliable, interpretable, and faithful.
Pengcheng Jiang, Jiashuo Sun, Wonbin Kweon et al.· Proceedings of the 32nd ACM...· 0 citations
PMFRec learns a personalized representation generator to produce user-specific item representations from attribute features, and introduces a global multi-view encoder with item-adaptive gating and an orthogonality objective to capture complementary semantic views while reducing cross-view redundancy.
Jaehyung Lim, Wonbin Kweon, Woojoo Kim et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
