Author

Derek Li

h-index 0 View on Semantic Scholar

We have 1 of 1 papers

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

Jul 2026

Talaria: Session-Aware Serverless Serving of Hundred-Billion-Parameter LLMs

Talaria is presented, a session-aware serverless multi-model serving system that makes session continuity a joint placement-and-admission decision, and its router ranks placements by model residency, KV locality, and instance pressure.

Utopia Meng, Unicornt Zhao, Derek Li et al. · arXiv.org · 0 citations