Rethinking Sequence Compression with Test-time Regression
TTR-Compressor is evaluated as the compressor for block-wise sparse attention and the visual token merger for multimodal large language models and improves RULER performance over attention-based compressors by a large margin.