Preprint
Nov 2026
Shallow Encoding Emits Deep Memories
SEED makes the prefill shallow in depth and the decode state shallow in representation, and proves that the open-loop error of the periodic compressions back to low rank is bounded independently of their number.
Ming-Yuan Ma, Yang-Min Li, H. Nover et al.
· 0 citations