Large language models (LLMs) increasingly run on edge devices alongside tasks that continuously process sensor data. In many applications, these foreground tasks prepare observations as inputs to the LLM, whose outputs guide subsequent processing or actions. The observations must be processed by foreground deadlines, a...
Teng Mei, Cheng-Xuan Pei, Wei-Jun Wang et al.· 0 citations
This study describes GPU-fabric contention in LLM workloads and presents GPUWeaver, a context-aware communication scheduler that monitors application progress and fabric state, identifies contention, and dynamically regulates communication injection according to application performance goals.
Dan-Yang Chen, Yu-Feng Gu, Yi-Bo Huang et al.· Proceedings of the 17th ACM...· 2 citations
Preliminary but compelling evidence that MC-aware scheduling is a practical operating system/runtime direction for deployable embodied AI on unified memory edge devices is provided.
Teng Mei, Cheng-Xuan Pei, Marco Canini et al.· Proceedings of the 17th ACM...· 2 citations
CubeTrace is presented, a unified, function-level flow tracing system that enables microscopic tracing inside heterogeneous cloud gateways and introduces minimal overhead, consuming less than 1% of memory resources and adding less than 1% to forwarding latency.
Yunming Xiao, Yinchao Yang, Jiaqi Zheng et al.· Conference on Applications,...· 1 citation
XFir is the first hardware-accelerated new-flow setup system for cloud host servers that delivers high CPS throughput while preserving sufficient flexibility, and is cost-effective to deploy, requiring only a single DPU per host.
Shihan Lin, Shunqiao Jiang, Liang Wang et al.· Conference on Applications,...· 1 citation
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.