Rethinking Sequence Compression with Test-time Regression
TTR-Compressor is evaluated as the compressor for block-wise sparse attention and the visual token merger for multimodal large language models and improves RULER performance over attention-based compressors by a large margin.
Sihan Yang, Jie Huang, Han-Xuan Li et al.
· 0 citations