A comparison of two ways to help an LLM answer questions over a small research corpus: single-round Vector RAG and an LLM-compiled markdown wiki browsed by a tool-using agent, which system appears to win depends on the retrieval baseline, the scoring method, and the judge.
This empirical study is an independent reproduction of the dissociation Zhao reported in 2026, where the shape of a large language model's chain-of-thought entropy trajectory predicts whether the final answer is correct, while the magnitude of its total entropy drop does not.
Evaluating context mechanisms requires sequence-aligned term-level, insertion, and speaker-label measures alongside aggregate accuracy, and sequence-alignment analysis found a small improvement on complete context-listed phrases, too small to materially change side-level WER, and for Gemini coexisting with worsened unl...
Theodore O. Cochran, Stephanie Dodson, Keith Nore· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.