Skip to content
Conference Open access

EvidenceRank: an Explainable Evidence Retrieval Framework for Conversational Agents

Oct 2026 · Ubiquitous Computing, Electronics & Mobile Communication Conference · pp. 610-617 · 0 citations · 27 references

Abstract

This paper presents EvidenceRank, referred to as Glyph throughout this work, a desktop question-answering conversational agent and extractive summarization system for public-domain texts. The system addresses a practical retrieval problem: how to answer specific natural language questions from long literary, historical and scientific works without relying on labeled training data or external APIs. Error analysis identified recurring limitations in document and evidence scoring, including word-sense ambiguity, interference from structural metadata. The proposed system combines document ranking, query expansion, and an Anchor/Signal passage scoring method that separates topical alignment from informational intent. An optional retrieval-augmented generation layer using a locally hosted language model enables comparison between extractive and generative outputs. Our results suggest improved document selection and passage precision for question-answering systems used in conversational agents within the evaluated examples. The retrieval pipeline uses explicit scoring rules and runs locally.

Read PDF

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.