Residual Vector-based Reconstruction as Long-Context Recall Regardless of Context Window Size
A long-context recall method that maintains near-constant GPU memory usage as context length increases, without additional training is proposed, which enables answering single-fact questions in two-million-token story contexts where previous methods fail.