Author

George Rowlands

h-index 0 View on Semantic Scholar

We have 1 of 1 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

Linear Attention Architectures: Mechanisms, Trade-offs, and Cross-Layer Routing

A comparative study of softmax attention and four recent recurrent linear-attention architectures: DeltaNet, Gated DeltaNet, Kimi Delta Attention, and Gated DeltaNet-2 is presented, making explicit how they differ in expressivity, memory decay, erase and write control, training throughput, and implementation complexity.

Tommaso Cerruti, Tim Rieder, George Rowlands et al. · arXiv.org · 0 citations