OpWeave: Flexible Operator Disaggregation for Heterogeneous LLM Serving
OpWeave provides an analytical cost model that bounds the gains of homogeneous and heterogeneous ODS over colocated serving, and jointly optimizes operator partitioning and deployment configuration through a regularity-aware planner that keeps the search tractable even for hybrid-attention models.
Zi-Kun Li, Yixuan Mei, Shi-Qi Pan et al.
· 1 citation