Author

Emy Gervais

View on Semantic Scholar

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#machine learning Preprint Aug 2026

Sliding-window beats linear attention

This work shows that Sliding Window Attention (SWA) with sinks performs as well or better than post-trained Linear Attention models, and recommends switching to SWA instead of post-training linear models.

Alexia Jolicoeur-Martineau, R. Sukthanker, Pashmina Cameron et al. · 0 citations