Author

Yusheng Zhao

View on Semantic Scholar

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

#natural language process... Mar 2026

Switch Attention: Towards Dynamic and Fine-grained Hybrid Transformers

SwiAttn is a novel hybrid transformer that enables dynamic and fine-grained routing between full attention and sliding window attention, and dynamically routes the computation to either a full-attention branch for global information aggregation or a sliding-window branch for efficient local pattern matching.

Yusheng Zhao, Hourun Li, Bohan Wu et al. · arXiv.org · 4 citations