Jul 2026· International Conference on Information and Communicatiaon Technology· pp. 1-6· 0 citations· 25 references
Abstract
Conversational Query Reformulation (CQR) is an important component in Conversational Question Answering (ConvQA), where user queries are often incomplete, ambiguous, and dependent on previous dialogue turns. Recent CQR approaches have shown the effectiveness of large language models (LLMs) in generating standalone queries. However, rewritten queries do not always lead to optimal retrieval performance. This paper presents a retrieval-aware CQR framework that integrates fine-grained retrieval feedback and keyword augmentation to improve downstream document retrieval. Instead of treating the LLM-rewritten query as the final search query, our framework uses it to retrieve candidate documents, identify relevant paragraph-level evidence, generate a pseudo-answer, and extract semantically relevant keywords. These keywords are then filtered based on their alignment with the reformulated query and dialogue history before being incorporated into the final query. We evaluate the proposed framework on a sampled subset of the QReCC dataset using BM25 and GTR as sparse and dense retrieval backbones. The experimental results show that our proposed approach improves retrieval accuracy compared to the baseline model across all metrics such as Recall@10, MRR and NDCG. Specifically, under the BM25 sparse retrieval framework, our best-performing configuration achieves improvements in Recall@10 (81.29), MRR (56.06) and NDCG (60.92) compared to the baseline. A comparable pattern of substantial gains holds under the GTR dense retrieval framework, achieving a Recall@10 (76.51), MRR (53.26) and NDCG (57.54), indicating the effectiveness of our method across different retrieval paradigms.
Multi-turn interactions with LLMs are becoming increasingly common in information-seeking scenarios. However, user queries are often ambiguous and context-dependent, making them ill-suited for direct use as retriever queries. Conversational query reformulation (CQR) addresses this issue by rewriting the current utterance into a stand-alone query grounded in the dialogue history. Recent LLM-based CQR approaches achieve strong performance; however, their repeated LLM invocations and misalignment with downstream retrievers remain challenges. In this work, we begin from the observation that retrievers are highly sensitive to content ordering: simply reordering the same content can lead to changes in retrieval coverage and performance. Based on this, we propose a novel training-free method that generates a very large number of queries with minimal LLM usage by compositionally combining a small set of atomic components. We further apply LLM reasoning to construct a high-quality document set that balances precision and recall while capturing the user's core intent. Our framework generalizes across both open- and closed-source LLMs as well as dense and sparse retrievers. It achieves strong performance on four widely used conversational benchmarks, with up to 22.5% relative MRR improvement over the previous state-of-the-art baseline with far fewer LLM calls.
Yunah Jang, Kang-il Lee, Joongbo Shin et al.· 0 citations
This work presents Cross-Encoder Query Expansion (CE-QE), which reads the per-token relevance attributions of a cross-encoder applied to top semantic search results, selects the terms the cross-encoder treats as decisive, and appends them to the BM25 query.
Adam Kahirov, Umesh Deshpande, S. Sundararaman· 0 citations
Evaluation on a multi-page technical PDF document shows that the hybrid retrieval and re-ranking stages together raise retrieval precision and reduce irrelevant or unsupported answers compared with retrieval limited to a single method, supporting the use of this approach for reliable, document-grounded question answering.
Vishwa K Dave, K. Pallavi· International Research Journ...· 0 citations
Existing conversational retrievers commonly treat topical relevance as a proxy for answerability. However, a passage that closely matches the dialogue context is not necessarily the one that supports the correct answer. We identify this mismatch as a systematic answerability gap. To address this issue, we propose CLEAR, a framework that shifts conversational retrieval from topical relevance to answerability. The core of CLEAR is entailment distillation, which transfers answer-passage entailment supervision into a cross-encoder reranker so that the reranker discriminates answer-supporting passages from topical distractors at inference time, without requiring answers. CLEAR is complemented by a passage-centric abductive recall module that brings low-similarity yet answerable passages into the candidate pool by inferring answerable queries from passages with an LLM. Across TopiOCQA, QReCC, and out-of-domain TREC CAsT datasets, CLEAR consistently improves top-ranked precision over strong query-rewriting and dense-retrieval baselines, with the largest gains observed in conversations involving heavier topical noise. Moreover, applying our reranker on top of an LLM-driven query rewriter yields further gains.
Shuai Qin, Guo-Jia An, Wei-Kang Guo et al.· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.