Author

Yang Li

h-index 0 View on Semantic Scholar

We have 1 of 2 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Preprint Aug 2026

Autonomy-of-Heads: Data-Free Sparse Attention from Frozen Query-Key Geometry

This work proposes Autonomy-of-Heads (AoH), a data-free method that identifies retrieval and streaming heads from the spectral geometry of query-key projections that retains 96.5% of Full Attention performance on average while reducing prefill and decode latency by up to 41.4 and 66.0%, respectively, and KV-cache memor...

Ye-Han Yang, Jun-Yuan Shang, Yang Li et al. · 0 citations