Skip to content
Book Open access

Structure Shapes the Future of DataxLLM Systems: Retrieval, Structuring, and Reasoning

Aug 2026 · Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · pp. 13334-13338 · 0 citations · 17 references

TL;DR

This tutorial presents a unified vision in which structuring serves as the enabling foundation for three pillars of next-generation LLM systems, highlighting how the cooperative interplay between classical KDD techniques and modern LLMs-where KDD defines structural schemas and quality constraints while LLMs execute flexible extraction and reasoning-creates systems that are more reliable, interpretable, and faithful.

Abstract

Large language models (LLMs) have transformed AI, yet they remain fundamentally limited by hallucination, unverifiable reasoning, and shallow evidence grounding. We argue that structure mining-rooted in decades of KDD research on taxonomy induction, ontology design, entity typing, and knowledge graph construction-is the key to overcoming these limitations. This tutorial presents a unified vision in which structuring serves as the enabling foundation for three pillars of next-generation LLM systems: (1) Structured Retrieval, where organizing corpora into ontology-guided multidimensional representations enables SQL-like queries that achieve substantially more precise and complete retrieval than similarity-based approaches; (2) Structured Reasoning, where grounding each inference step in typed, graph-structured evidence transforms opaque generation into auditable, verifiable reasoning chains; and (3) Structured Agent Memory, where multi-dimensional memory architectures bridge external corpus knowledge and experiential agent knowledge through a mutually enriching dual-memory design. Across all three pillars, we highlight how the cooperative interplay between classical KDD techniques and modern LLMs-where KDD defines structural schemas and quality constraints while LLMs execute flexible extraction and reasoning-creates systems that are more reliable, interpretable, and faithful. The tutorial covers both foundational methods and the latest advances (2024--2026), and concludes with open problems and future research directions at the intersection of data mining and LLMs.

Read PDF

Similar papers

Book Open access Aug 2026

Docling: Converting Complex Documents into AI-Ready Structured Representations

By bridging the gap between visually complex documents and machine-readable knowledge, Docling provides a foundation for reliable document understanding in next-generation AI systems.

P. Staar · 0 citations
Book Open access Jul 2026

Reasoning for IR & IR for Reasoning

This tutorial first articulates a working definition of reasoning within the context of information retrieval and derives from it a unified analytical framework, which maps existing approaches along axes that reflect the core components of the definition.

Mohanna Hoveyda, Panagiotis Eustratiadis, Arjen P. de Vries et al. · 1 citation
Preprint Jul 2026

EvoGraph-R1: Self-Evolving Multimodal Knowledge Hypergraphs for Agentic Retrieval

EvoGraph-R1 is introduced, a self-evolving GraphRAG framework that reconceptualizes knowledge graphs as dynamic environments shaped through agent interactions, establishing self-evolving knowledge graphs as a fundamental paradigm across modalities.

Jiashi Lin, Changhong Jiang, Xiangru Lin et al. · 1 citation
Book Open access Aug 2026

From Retrieval to Reasoning: Building Language-Steerable Discovery Systems at Spotify

For decades, search and recommendation systems have been optimized as distinct components within large-scale discovery platforms. The rise of generative AI is beginning to blur this boundary. At Spotify, we are exploring how large language models can evolve from tools that retrieve content into systems that reason over users, catalogs, and intent, while remaining steerable through natural language and user interaction. This talk presents lessons from deploying and studying generative retrieval and recommendation systems across Spotify's content ecosystem. I will describe how semantic identifiers enable language models to operate directly over large, heterogeneous catalogs, allowing search, recommendation, retrieval, explanation, and user understanding to be expressed within a common generative framework. I will discuss recent work on production-scale podcast discovery, language-steerable recommendation, and the NEO framework for unifying search, recommendation, and reasoning across multiple content types. These systems demonstrate how grounding language models in catalog entities and user behavior can improve discovery while preserving the flexibility of natural-language interaction. More broadly, they suggest a path toward discovery systems in which retrieval, recommendation, and reasoning are no longer separate stages, but capabilities of a shared generative model. Beyond model frameworks, I will discuss the emerging challenges of alignment and evaluation in discovery systems. Unlike traditional retrieval problems, generative recommendation often has many valid answers. I will present approaches for learning from large-scale behavioral signals, preference-aware optimization, and profile-aware LLM-as-a-judge evaluation, along with lessons from online experimentation at Spotify. These experiences suggest that future discovery systems will require new forms of personalization, controllability, and evaluation that extend beyond conventional ranking metrics. I will conclude with a research agenda for generative discovery systems, including language-steerable interfaces, unified retrieval-and-reasoning models, preference-aligned generation, and evaluation frameworks designed to measure user-specific relevance at scale. As search, recommendation, and conversational AI continue to converge, these directions point toward a new generation of discovery systems that can understand intent, reason over large catalogs, and help users navigate increasingly complex information spaces.

Paul N. Bennett · 0 citations
Jul 2026

ERUnderstand: Evaluating Vision-Language Models on Structured ER Diagrams

Entity-Relationship Diagrams (ERDs) are central to conceptual database design, yet they are typically available only as rendered images rather than machine-readable schemas, limiting AI-assisted database engineering. We introduce ERUnderstand, the first large-scale benchmark for structured understanding of ER diagrams, comprising 2,960 diagrams collected from curated educational sources, real-world schemas, and synthetically generated examples spanning diverse domains, notations, complexity levels, and Extended Entity-Relationship (EER) constructs. Each diagram is paired with a standardized machine-readable representation for fine-grained evaluation of schema elements. Evaluating state-of-the-art Vision-Language Models (VLMs), we find that while common ERD elements are recovered reliably (F1>0.74), performance drops sharply on weak entities (as low as 0.28 F1), multivalued attributes (0.14 F1), and N-ary relationships (0.07 F1). Reasoning-augmented models improve overall performance by 15-25% but remain sensitive to linguistic priors and increasing diagram complexity. ERUnderstand provides a standardized benchmark for evaluating multimodal understanding of conceptual database schemas. The benchmark, dataset, evaluation toolkit, and generation code are publicly available at https://github.com/salinaria/ERUnderstand.

Ali Ansari, Yasmin Mohammadi, Farnoush Nili et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.