Skip to content

Author

Xuan Truong Nguyen

1 paper indexed here

We haven’t gathered this author’s papers yet. Follow them and we’ll fetch their work.

Not the right person? Other researchers publish under this name.

DPS: Dual-Mode Precision LLM Serving with Semi-Unified Memory

DPS is a dual-precision LLM serving system that turns weight memory into an elastic resource: under normal load, DPS serves the full-accuracy model; under KV pressure, it switches to a nested, lower-precision variant and repurposes unused weight memory for KV cache blocks.

Xuan Truong Nguyen, Tien-Son Pham, Tuan-Duc Chu et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.