No Detectable Change in Side-Level WER from Prompt-Level Context: A Preregistered Ablation on a Production Oral-History Corpus
Evaluating context mechanisms requires sequence-aligned term-level, insertion, and speaker-label measures alongside aggregate accuracy, and sequence-alignment analysis found a small improvement on complete context-listed phrases, too small to materially change side-level WER, and for Gemini coexisting with worsened unlisted-token error.
Theodore O. Cochran, Stephanie Dodson, Keith Nore
· 0 citations