Sequence Compression

Rethinking Sequence Compression with Test-time Regression

Introduction In models that handle long contexts, the compression operation that reduces multiple tokens to a single vector becomes a performance bottleneck. This paper…