Skip to content
Book Open access

PYTHIA: Universal Question Answering over Knowledge Graphs

Aug 2026 · Proceedings of the 32nd ACM SIGKDD Conference on Knowledge Discovery and Data Mining V.2 · pp. 2285-2296 · 0 citations · 11 references

Abstract

Knowledge graph question answering (KGQA) focuses on answering questions with data retrieved from knowledge graphs (KGs). Although Large Language Models (LLMs) have enabled the development of innovative KGQA systems, serious challenges remain. Approaches that utilize supervised finetuning are accurate and responsive, but also require large training datasets that provide good coverage of both the target knowledge graph and expected user questions. Likewise, integrating KG-specific optimizations improves accuracy and responsiveness but limits versatility and is susceptible to updates to the KG's ontology. LLMs have facilitated the development of training-free and KG-agnostic solutions that utilize reasoning and real-time decision making to explore the target KG, but the semi-structured nature of KGs makes this a complex and unpredictable task, leading to performance degradation and longer response times. In this paper we present PYTHIA, a training-free, plug-and-play solution for KGQA over any RDF KG. At its core, PYTHIA consists of an LLM agent guided by a relation-centric conceptual model of the KGQA task which is acted upon through a suite of tools for entity linking, graph exploration and query execution. The agent is responsible for interpreting user intent, orchestrating tool calls, and evaluating tool output, while the tools themselves present simple interfaces that abstract complex processes, reducing cognitive load on the agent. To assess its viability, we perform a comprehensive evaluation of PYTHIA and prior systems across four knowledge graphs and six datasets. The results show PYTHIA achieving a median performance improvement of 15.31% while improving cost and time efficiency at the performance frontier.

Read PDF

Similar papers

Preprint Sep 2026

KGVoyager: Knowledge Graph Agnostic Question Answering via Agentic Navigation

Knowledge Graph Question Answering (KGQA) over RDF graphs remains challenging in domain-specific settings, where formal ontologies and curated text-SPARQL pairs are often unavailable. We present KGVoyager, a KG-agnostic agentic architecture that generates SPARQL queries from natural language questions by dynamically discovering graph structure and semantics, requiring only a query endpoint of the underlying graph. Using a think-act-observe loop with search, exploration, and execution tools, KGVoyager maps terms to graph IRIs, uncovers structure, and refines queries through execution feedback - all without pre-existing ontologies or examples. Unlike the prior state of the art, KGVoyager requires only a lightweight class index which renders it applicable for far more real-world endpoints. Across four benchmarks, KGVoyager improves F1 by ~8 points while cutting cost and runtime by ~22% each.

Essam Wisam, Cheng-Kai Li · 0 citations
Jul 2026

MARS: Multi-hop Adaptive Retrieval and SPARQL Generation for KGQA

This work proposes MARS, a scalable knowledge graph question answering (KGQA) approach that requires no model fine-tuning, and performs a structured retrieval procedure that links question entities to the KG and iteratively retrieves relevant next-hop information.

Nikit Srivastava, Daniel Vollmers, René Speck et al. · 0 citations
Conference Jul 2026

OASA-KGQA: Ontology-Aware Semantic Agent for Knowledge Graph Question Answering

In order to enable natural language interaction with structured knowledge bases based on ontologies, widely used to represent knowledge in multiple complex domains, Knowledge Graph Question Answering (KGQA) systems are required. Large Language Models (LLMs) can play a pivotal role in this context, however they suffer from factual inaccuracies, hallucinations, and difficulties in navigating complex semantic schemas. To address these limitations, this paper proposes a novel neuro-symbolic Agentic AI framework for KGQA on real-world knowledge graph. By integrating neural reasoning capabilities of LLMs with symbolic tools within a recursive flow orchestrated by LangGraph, the system is able to identify relevant terms, validate them based on specific ontology, and generate SPARQL queries for data retrieval. To demonstrate effectiveness of this approach an experimental evaluation using a real-world smart city knowledge base, implemented in the Snap4City platform, is carried out. Results indicate that the neuro-symbolic workflows improves the accuracy of information retrieval for non-expert users compared to standalone LLM solutions.

Zahra Fereidooni, M. Fanfani, G. Pantaleo et al. · 0 citations
Open access Aug 2026

Constrained Entity Selection Under Partial Knowledge for LLM-Based Knowledge Graph QA

Large language models are increasingly used for knowledge graph question answering (KGQA), but can fail to correctly ground answers in the underlying graph. Current approaches to LLM-based KGQA either rely on full semantic parsing into executable queries such as SPARQL, which is brittle in practice due to complex schemas or incompleteness of real-world KGs, or on LLM-reasoning and answer generation over KGs, which can be more robust but lacks formal guarantees. In this work, we study a complementary setting in which \emph{candidate} answers are generated by an LLM-based system and subsequently verified using lightweight symbolic constraints derived from the question. We introduce \emph{Constrained Entity Selection under Partial Knowledge (CES-PK)}, a problem formulation that focuses on eliminating invalid answers and providing symbolic support for valid ones without requiring construction of executable logical forms. To account for incomplete KGs, we employ a three-valued constraint semantics (\emph{satisfied, violated, unknown}) that avoids incorrect rejections under open-world assumptions. To demonstrate the effects of our method, we instantiate this framework over the Hetionet biomedical knowledge graph and evaluate the impact of type, relation, and exclusion constraints. Experiments show that precision improves by filtering invalid candidates, while recall is preserved due to retaining candidates whose constraints are not explicitly violated. Satisfied constraints provide additional positive symbolic evidence to rank remaining candidates.

E. Kitzelmann · 0 citations
Preprint Aug 2026

KGCaRe: Explainable Complex Conditional Question Answering using Automatic Knowledge Graph Construction and Context Retrieval with LLMs

KGCaRe is proposed, a hybrid approach that combines neural retrieval with symbolic reasoning over LLM-generated KGs that consistently outperforms existing baselines, including Vanilla LLM, Code Prompt, Text Prompt, Think-on-Graph, Vanilla RAG, and HybridContextQA.

Ghanshyam Verma, Sima Sarkar, Devishree Pillai et al. · 0 citations
Preprint Aug 2026

KGCache: Amortized Subgraph Retrieval for KG Reasoning with LLMs

This work proposes KGCache, an in-memory cache for one-hop knowledge graph neighborhoods, which is designed to be compatible with both iterative traversal (ToG) and one shot planning (RoG) KGQA paradigms and shows substantial entity reuse among starting entities and entities reached during traversal.

Uros Stanic, Chang-He Yuan, Sabuj Laskar et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.