AI Networking Cookbook: Practical recipes for AI-assisted network automation and development
We have 2 of 3 papers
We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.
Not the right person? Other researchers publish under this name.
GAUSS is presented, a workload-aware analytical and Monte-Carlo simulator that predicts the full distributions of time-to-first-token (TTFT) and time-between-tokens (TBT), together with the sustainable request rate, for a given workload, engine, and accelerator.
Kascade is a training-free sparse attention method that leverages known observations such as 1) post-softmax attention is intrinsically sparse, and 2) the identity of high-weight keys is stable across nearby layers to achieve high accuracy on long-context LLM inference.
We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.