Sep 2026
KD-GAG: Knowledge-distilled graph-augmented generation via preference-aware subgraph pruning.
A novel framework KD-GAG is proposed that efficiently constructs KGs by distilling teacher LLMs' semantics and reasoning into a smaller student LLM and a preference-based subgraph pruning method to optimize the retrieval process.
Long Zhao, Yin Xu, Yan-Yan Wang et al.
· Neural Networks · 0 citations