Skip to content
Open access

Modeling Response Uncertainty and Item Relevance in Conversational Recommender Systems

Jul 2026 · ACM Transactions on Information Systems · Vol 44, pp. 1 - 33 · 0 citations · 71 references

TL;DR

A Semantic-enhanced CRS (SCRS) is proposed that explicitly models response-based semantic uncertainty and item-based semantic relevance to enhance both response and recommendation quality and achieves significant improvements in both recommendation accuracy and response quality over state-of-the-art baselines.

Abstract

Conversational Recommender Systems (CRSs) aim to extract user preferences from natural language interactions and deliver personalized recommendations through conversations. In multi-turn conversations, these systems often generate low-confidence responses when user intent is unclear, leading to inappropriate replies and a degraded user experience. However, existing CRSs rarely assess the confidence of generated responses or detect their semantic uncertainty. Additionally, limited modeling of item-based semantic relevance hinders the system’s ability to produce contextually coherent and preference-aligned recommendations. To this end, we propose a Semantic-enhanced CRS (SCRS) that explicitly models response-based semantic uncertainty and item-based semantic relevance to enhance both response and recommendation quality. Specifically, in conversation tasks, SCRS samples multiple candidate responses and estimates their semantic uncertainty by combining generation probabilities with semantic analysis, serving as a constraint to guide fine-tuning and improve response quality. In recommendation tasks, SCRS enriches item representations by integrating textual knowledge and calculates semantic relevance between items, then applies a dynamic optimization strategy to refine the recommendation process, generating items better aligned with user preferences. Extensive experiments on two public datasets demonstrate that SCRS achieves significant improvements in both recommendation accuracy and response quality over state-of-the-art baselines, validating the effectiveness of our proposed method.

Read PDF

Similar papers

#artificial intelligence Preprint Sep 2026

Re2A: Situated Conversational Recommendation via Rubric-based Preference Reasoning and Alignment

This work introduces rubric-based preference reasoning, which uses automated rubrics to guide the model toward producing explicit preference states, and proposes a preference-conditioned optimization to align response generation with dual objectives: user preference satisfaction and situation consistency.

Dongding Lin, Jian Wang, Xiao-Ya Zhao et al. · 0 citations
Open access Aug 2026

Large Language Model Agents for Recommender Systems: Bridging Behavior and Semantics with Long-Short Term Interest Modeling

This study presents an exploratory LLM-agent-based hybrid recommender system framework, building upon a multi-armed bandit approach, which enables semantic understanding of item content and integrates both short-term and long-term user interaction behaviors for recommendation.

Yiming Cheng, Yi-Tong Ma, Jingyu Wang et al. · 1 citation
Preprint Oct 2026

Adapting Generative Recommenders for Multi-Turn Interaction

Generative recommenders decode items from a user's interaction history, but offer no way for users to correct a recommendation that misses their current intent. Adding conversation is natural since items and words share same output space, yet training the model to converse may overwrite the history-to-item mapping it r...

Yuliia Den, Zhi Rui Tam, Yung-Yu Shih et al. · 0 citations
Book Open access Sep 2026

Choosing What Matters: Query-Aware Multimodal Routing for Conversational Recommendation

Query-Aware Multimodal Routing for Conversational Recommendation (QAMR-CRS), which predicts modality weights from dialogue context and mentioned entities, routes knowledge graph, co-occurrence, text-similarity, and image-similarity evidence at the entity level, and converts the routed evidence into prompt prefixes, is...

Hui-Ling Piao, Seoin Choi, Sokphea Young et al. · 0 citations
Preprint Aug 2026

Ask to Be Sure: Informative Interactions for Confident Multi-Turn LLM Recommendation

This work proposes a new approach that quantifies the effectiveness of each interaction by the reduction in the assistant's uncertainty, measured via entropy over recommendations, to fine-tune the LLM, enabling strategic interaction generation.

Cedar Site Bai, Zhen-Yu Liao, Duan Li et al. · 0 citations
Open access Aug 2026

Decoupled Decision-Stage Awareness for Conversational Recommendation with Large Language Model Agents in Information Analysis

Information analysis recommendation differs from conversational recommender systems (CRS) because relevance changes with the decision phase. The same event may support observation, interpretation, option selection, or action feedback, yet most large language model (LLM)-agent CRS represent dialogue state as intent and...

Chao-Yang Li, Yiwei Lu, Bo Huang et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.