ServerlessT2I is presented, a serverless-native system that decomposes a T2I workflow into loosely coupled model functions that can be independently managed and scheduled and introduces a fair scheduler for multi-tenant serving.
Xiao-Xiao Jiang, Su-Yi Li, Sheng Yao et al.· arXiv.org· 0 citations
Xema is presented, a memory-efficient diffusion serving system that exploits predictable tensor lifetimes for trace-guided memory optimization and introduces an offline planner that jointly selects parallelism, concurrency, and memory control under GPU memory and SLO constraints.
Xueze Kang, Guangyu Xiang, Suyi Li et al.· arXiv.org· 1 citation
Rollplex is presented, a runtime that decomposes the reference and training phase and moves the prefix computation into the rollout decode window and achieves speedup over serial colocation and disaggregation under the same GPU budget, while preserving the synchronous RL update.
Han-Feng Lu, Tian-Yu Feng, Su-Yi Li et al.· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.