Experiments on SemEval-2017 and WebPun show that PunGraph consistently improves the performance of small-scale LLMs and achieves competitive results against strong proprietary models, highlighting the benefits of integrating structured knowledge with LLMs.
Abstract
Puns are a challenging form of figurative language that exploit phonetic similarity and semantic ambiguity to convey multiple meanings. Although large language models (LLMs) demonstrate strong language understanding capabilities, they still struggle with pun reasoning due to limited phonetic modeling and uncontrolled end-to-end generation. We propose \textbf{PunGraph}, a retrieval-enhanced knowledge graph framework for pun understanding. PunGraph constructs a phonetic-semantic lexical graph using the Unisyn phonetic dictionary, IPA and G2P representations, and WordNet definitions, and retrieves candidate words or senses to constrain LLM reasoning within a structured candidate space. We further introduce \textbf{WebPun}, a new large-scale dataset containing 5,730 annotated heterographic and homographic puns. Experiments on SemEval-2017 and WebPun show that PunGraph consistently improves the performance of small-scale LLMs and achieves competitive results against strong proprietary models. Further analysis shows that retrieval-guided phonetic and semantic constraints effectively reduce common reasoning errors in pun interpretation, highlighting the benefits of integrating structured knowledge with LLMs. We release our code and dataset at https://github.com/ysu132/PunGraph.
Tokenization forms the foundation of modern Natural Language Processing (NLP) systems by transforming raw text into discrete units that neural language models can process. The effectiveness of this process directly influences vocabulary efficiency, sequence length, computational cost, and downstream model performance....
V. HariKrishnanK, Sudarsun Santhiappan· 0 citations
A layer-wise analysis indicates that surface-level features such as temporality and negation are captured more reliably than deeper semantic phenomena like quantification in large language models, highlighting the limited capacity of current LLMs to generate fully formal meaning representations.
Rémi De Vergnette, Maxime Amblard· International Conference on...· 0 citations
A robust WSD model that integrates a bidirectional long shortterm memory network (BiLSTM) with an attention mechanism, specifically designed for Chinese patent texts is proposed, providing reliable support for knowledge mining and intelligent text processing in technical domains.
L.-X. Gao, T. Dong, M.-H. Yang· Advanced Electromagnetics· 0 citations
A GAT-BiLSTM fusion model that integrates dependency syntactic analysis with graph attention mechanisms and bidirectional long short-term memory networks improves translation fidelity and semantic consistency while exhibiting strong robustness for structurally complex inputs.
J. Leng, X. Lin· Advanced Electromagnetics· 0 citations
Progress in natural language processing (NLP) has primarily benefited high-resource languages. Although Arabic now has access to substantial corpora and widely used pretrained language models such as AraBERT and MARBERT, it still exhibits a significant imbalance, particularly in the availability of structured lexical–s...
Leila Nouri, H. Aliane· ACM Transactions on Asian an...· 0 citations
As a representative Chinese classical text, the Analects has been translated into English in many versions over a long historical period, and different translators show substantial variation in concept rendering and language style. To address the lack of a quantifiable and reproducible framework for comparing semantic...
Tang He, Peng Dai, Rong Wang et al.· PLoS ONE· 0 citations
Related blog posts
MIT News · Artificial Intelligence· news.mit.eduSep 24, 2026
With millions of users across the world, Julia has been used to conduct cutting-edge research and to design new drugs, jet engines, heat pumps, and more.
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.