GTR: Gated Token Recurrence for Efficient Dense Prediction
Results show that recurrent token mixing can provide an efficient alternative to global softmax attention for high-resolution dense prediction and edge deployment, and are shown to be faster than FLA v0.5.
Zhe Feng, Long-Fei Liu, Wei Liu et al.
· 0 citations