Author

UALinkNVlink

h-index 0 View on Semantic Scholar

We have 1 of 1 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Reimagining LLM Inference Infrastructure with Memory-Centric KV Cache Servers

It is argued that a KV cache server — disaggregated, CXL-attached memory device(s) with optional near-memory compute—is the correct infrastructure primitive for the next generation of AI data centers.

Khyati Kiyawat, Kevin Skadron, UALinkNVlink · 0 citations