Alden Do Rosario

Why RAGs Hallucinate: Penalty-Aware Evaluation of Retrieval-Augmented Generation Systems with Knowledge-Gap Canaries

A penalty-aware evaluation framework for deployed RAG products is presented, combining asymmetric scoring, knowledge-gap canaries, questions whose answers are verifiably absent from the knowledge base, so that any answer constitutes ungrounded generation from parametric memory, and a failure-attribution pipeline that s...