Skip to content

Author

Joshua Nunley

We have 1 of 9 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

TANGO: Token-Aggregated Nonlinear Gating Operators for Natural and Formal Language Modeling

The TANGO model (Token-Aggregated Nonlinear Gating Operators), which replaces these two sublayers with one cross-token gated residual update, obtains the lowest mean validation negative log-likelihood on FineWeb-Edu, Lean, and DeepMind Mathematics, although it has the largest analytical forward-pass operation count.

Joshua Nunley · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.