Aug 2026· Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2· pp. 2873-2884· 0 citations· 12 references
TL;DR
By decoupling knowledge injection from prompt length, the KGA-LM approach mitigates retrieval signal decay under long contexts, offering a superior trade-off between grounding quality and inference efficiency.
Abstract
Integrating structured knowledge graphs (KGs) with Large Language Models (LLMs) is essential for trustworthy, knowledge intensive conversational systems. However, existing Retrieval Augmented Generation (RAG) methods typically rely on a retrieval-as-context paradigm that linearizes structured subgraphs into unstructured prompt tokens. This approach not only flattens rich structural dependencies but also leads to context inflation and evidence attenuation in multi-turn dialogues. To address these limitations, we propose KGA-LM, a framework that integrates external knowledge via representation-level grounding. Rather than treating retrieved evidence as transient input artifacts, KGA-LM encodes compact multi-hop subgraphs using a Graph Transformer and fuses them into the LLM decoder through a compatibility-aware latent interface. This design aligns the heterogeneous latent spaces of the graph encoder and the LLM, while a dual-gated fusion mechanism dynamically regulates the influence of non-parametric graph evidence across turns. Experiments on multiple conversational benchmarks demonstrate that KGA-LM significantly improves factual accuracy and reduces hallucination compared to prompt-linearized baselines. Crucially, by decoupling knowledge injection from prompt length, our approach mitigates retrieval signal decay under long contexts, offering a superior trade-off between grounding quality and inference efficiency.
LLM-based chat systems have become valuable tools for design practice, enabling rapid ideation and flexible task support. Yet these systems process designer utterances as generic sequences, maintaining context through recency rather than through any model of how the speaker organizes knowledge. In design conversation, this gap compounds as relational context decays between turns, identical words go unresolved across designers, and the conversation loops or restarts rather than deepens. We present CogChat, a real-time chat framework that grounds conversational AI in a personal heterogeneous knowledge graph constructed from each designer's input. The system extracts typed entities and relations into a heterogeneous graph, then applies a HGT (Heterogeneous Graph Transformer) to select structurally relevant nodes for response generation and to generate both intentional and exploratory probing questions. Technical evaluation shows that HGT-based entity selection outperforms both ungrounded LLM interaction and naive KG augmentation, which introduces noise that degrades response quality. A within-subjects study with nine professional designers indicates that grounding conversation in a relationally structured, designer-specific semantic context improves context retention, personalized intent interpretation, and conversational depth while reducing cognitive load. These findings suggest that structuring a designer's expressed concepts and relations as a dynamic knowledge graph can preserve relational context that fades across turns, pointing toward a graph-grounded approach to long-term context management in LLM-based interaction.
A multilevel-attention and hybrid-embedding framework that integrates FastText subword representations with multilingual BERT with potential applicability to other African languages is proposed to improve semantic understanding and context retention in conversational agents for Igbo.
G. C. Uzoaru, I. Ayogu, J. N. Odii et al.· Journal of the Nigerian Soci...· 0 citations
This framework performs LLM knowledge elicitation to extract factual knowledge from the model’s internal representations and transforms sentence-level representations into entity-level representations and aligns them within a unified space.
Deyu Chen, Qiyuan Li, Jinguang Gu et al.· 0 citations
MGDR-SDR is proposed, a training-free approach that applies constituency parsing to derive three complementary representations of the utterance that drive a multi-granular retrieval procedure that aggregates evidence across dense and sparse channels, yielding broader and more precise demonstration coverage.
Tong Li, Zhipeng Du, Xinyu Hu et al.· Machine Learning and Knowled...· 0 citations
This work proposes continuous-query LMLM (CO-LMLM), where the KB pairs continuous keys with textual knowledge values, a significant departure from prior reliance on relational KB and queries, which outperforms prior LMLMs and vanilla LLMs in both perplexity and factual precision.
Yair Feldman, Lin-Xi Zhao, Nathan Godey et al.· 0 citations
Extensive experiments demonstrate that AgentsKG outperforms state-of-the-art training-free baselines in both extraction accuracy and structural quality, offering a robust approach to open-domain knowledge graph construction without additional training.
Shilong Liu, Yongqiang Liu, Jiye Liu et al.· Proceedings of the 32nd ACM...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
