It is shown that the trade-off between locality and balance holds only where each silo can hold several relations, weakening as the number of silos increases, and the study provides practical guidance for deployments constrained by cross-silo reasoning or by silo load.
Abstract
Knowledge graphs are increasingly distributed across autonomous organizations that share an entity space but own disjoint subsets of relations, forming a vertical partition. Answering a multi-hop query may require combining facts from several silos, making the partitioning strategy a key data management decision that affects communication, indexing, load balance, and query latency. However, the costs associated with different partitioning strategies remain insufficiently studied. We formalize vertical partitioning as a design space and compare four strategies: semantic domain grouping, frequency-balanced partitioning, co-occurrence graph-cut partitioning, and random partitioning. We evaluate them using five metrics: communication cost, candidate index size, cross-silo path length, load balance, and end-to-end query latency. Three of the five prove to be determined by the graph and the silo count rather than by the partition, which reduces the design problem to two conflicting axes, cross-silo path length and load balance. Experiments on MetaQA and PathQuestion use a fixed federated knowledge graph question-answering architecture based on TransE embeddings and a frozen BERT encoder across three silo configurations. By keeping the learning model unchanged, we isolate the effect of partitioning and show that the trade-off between locality and balance holds only where each silo can hold several relations, weakening as the number of silos increases. The study provides practical guidance for deployments constrained by cross-silo reasoning or by silo load.
Real-world data for knowledge graph question answering is often distributed across different organizations due to governance and data sovereignty constraints. While centralized systems exist, they cannot answer multi-hop questions when the required facts are split across vertically partitioned silos. In this paper, we...
Md. Saikat Islam Khan Bappy, O. Seneviratne· 2 citations
The results show how established optimization principles can be applied across conceptual, mapping, data-model, and DBMS boundaries in decomposition-based multi-model query processing.
Jáchym Bártík, Filip Štrobl, Irena Holubová· 0 citations
Modern data-driven applications increasingly rely on distributed graph databases and machine learning pipelines to extract knowledge from massive datasets. However, efficient query processing in distributed environments remains challeng-ing due to
issues such as graph partitioning inefficiencies, dynamic connectivity u...
Praveen Kumar Kumbum, Ramachandra Reddy Vangala· Journal of Business Intellig...· 0 citations
Vector databases use hashing to partition data across"shards,"logical units for distributed execution. This placement, however, destroys semantic locality, forcing each query into scatter-gather limited by the slowest shard. Vector-space clustering can help, but scientific evidence is often connected by factual relatio...
Song Young Oh, Amal Gueroudji, Seth Ockerman et al.· 0 citations
PEARL augments the retrieval corpus offline by generating multi-hop queries over pre-identified join paths and reorganizing relevant columns into vertically partitioned corpus units, enabling effective multi-table retrieval without query-time LLM inference.
S. Ho, Hyeongu Kang, Seongku Kang et al.· 0 citations
The empirical findings of FedV-KGQA on multi-hop question answering over vertically partitioned graphs are presented, and an interactive prototype that runs real inference and traces the full pipeline, per question, on released checkpoints is contributed.
Md. Saikat Islam Khan Bappy, O. Seneviratne· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduOct 13, 2026
Machine-learning networks can learn without detailed instructions from a designer. Those that do may offer insight into how the brain reorganizes itself during learning.
With $2.1 million funding from Google.org, the open-source Public Transit Intelligence Hub will unify public transit monitoring, operations, and passenger communication.