Do LLMs Understand Context? A Knowledge Graph-Based Evaluation Framework
A novel knowledge graph (KG) based evaluation framework for LLM contextual understanding in QA is proposed and central to this is Semantic Structural Similarity for KGs (S3KG), a hybrid similarity measure combining structural and semantic signals into a single score.