A new adaptive function fusion strategy that dynamically reconstructs serverless workflows by adjusting communication schemes between functions in response to changing workflow invocations is proposed, which jointly optimizes function fusion and instance reconfiguration through an efficient beam-search–based algorithm...
Zi-Xuan Lin, Jian-Xiong Liao, Zhi Zhou et al.· ACM Transactions on Architec...· 0 citations
MIGServe treats the physical layout of MIG instances as a first-class scheduling dimension through three techniques: buddy-aware partition placement, which preserves large contiguous free blocks by allocating next to existing occupied buddies; proactive pair-matching migration, which consolidates fragmented half-full b...
Jian-Wen Chen, Yun-Kai Liang, Bin Gao et al.· Proceedings of the Internati...· 0 citations
MIGServe treats the physical layout of MIG instances as a first-class scheduling dimension through three techniques: buddy-aware partition placement, which preserves large contiguous free blocks by allocating next to existing occupied buddies; proactive pair-matching migration, which consolidates fragmented half-full b...
Jian-Wen Chen, Yun-Kai Liang, Bin Gao et al.· Proceedings of the Internati...· 0 citations
The widespread adoption and strong generalizability of large language models (LLMs) lead to highly heterogeneous workloads that exhibit substantial variability in request lengths and latency requirements. This pronounced heterogeneity causes existing scheduling strategies to suffer from head-of-line blocking and ineffi...
Tian-Nan Fu, Jianxiong Liao, Xu Chen et al.· Fall Joint Computer Conferen...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
