Skip to content

Author

Saurabh Goyal

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Kascade: A Practical Sparse Attention Method for Long-Context LLM Inference

Kascade is a training-free sparse attention method that leverages known observations such as 1) post-softmax attention is intrinsically sparse, and 2) the identity of high-weight keys is stable across nearby layers to achieve high accuracy on long-context LLM inference.

Dhruv Deshmukh, Saurabh Goyal, Nipun Kwatra et al. · 10 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.