DeltaS: Reading the Gated Linear Attention State for KV Cache Eviction in Streaming Video
DeltaS is proposed, a query-agnostic, training-free method that retains video chunks inducing larger normalized state change, or state drift, in a controlled comparison with the budget and retention policy held fixed, which suggests that the two memories of hybrid architectures can work cooperatively.
Taeyoun Kwon, Seungjin Kim, Hyeonyu Kim et al.
· 0 citations