Verbalizing LightGCN: Direct Learning of Textual Representations from User-Item Interaction Graph via LLMs

Abstract

In this work, we propose VerbaLightGCN, a novel LLM-based recommendation framework that integrates the semantic understanding of LLMs with user-item interaction modeling. Traditional collaborative filtering (CF) models typically embed user and item IDs into a latent space to capture interaction signals. However, pretrained LLMs cannot natively interpret these learned embeddings. To bridge this gap, VerbaLightGCN adopts a CF-as-text paradigm, in which collaborative signals are encoded in textual form and directly learned from the user–item interaction graph, and are then combined with semantic information to construct user and item profiles that function as latent embeddings. Inspired by LightGCN, our method retains its message-passing design but replaces numerical embedding computations with a Chain-of-Thought prompting mechanism. This enables LLMs to simulate the LightGCN aggregation process through natural language. The result is a recommendation framework that unifies semantic understanding with collaborative signals in a fully language-native form. Experiments show that VerbaLightGCN achieves superior performance to both zero-shot LLM-based and traditional CF-based baselines. Further analysis reveals that the user and item profiles generated by VerbaLightGCN effectively capture both semantic preferences and collaborative filtering signals.