Sep 2026· Proceedings of the International Conference on Parallel Processing· pp. 45-55· 0 citations· 19 references
Abstract
As applications demand increasing memory capacity in clouds, memory pooling provides a cost-effective way to improve utilization and expand capacity. Compute Express Link (CXL), which enables high-performance direct access to remote memory, makes this approach increasingly practical. However, existing studies of memory offloading fall short when multiple applications share a memory pool, as they overlook application heterogeneity and cross-application interference. We present Aethon, a memory offloading system for public clouds that maximizes offloaded data while ensuring each application satisfies the service-level agreement (SLA). Aethon integrates an application-transparent predictor to estimate offloading-induced performance degradation, and adaptively determines cold- and hot-data offloading volumes for each application. Compared with representative work, Aethon offloads 14.2% more data on average (up to 27.4%), while satisfying SLA requirements.
VIPER is presented, a unified, lightweight, and architecture-aware performance evaluation framework for PIM DSE, providing rapid architecture-aware performance estimates for iterative DSE without repeated cycle-accurate simulation.
Hao-Ran Geng, T. Pereira, Xiaoyang Lu et al.· 0 citations
An eBPF-based scheduling framework is designed and implemented that complements existing kernel mechanisms to improve the accuracy of fine-grained CPU allocation while maintaining low overhead and demonstrates that the proposed approach significantly reduces resource overallocation and performance variability compared...
Chang-Yuan Lin, Mohammad Shahrad· Proceedings of the 4th Works...· 0 citations
Gutenberg, a CPU+NDP for mutable, latency-critical cloud services, outperforms prior systems, reducing average and p99 latency by up to 80.4% and 85.8% and improves isolation and fairness while adapting to changing workload behaviors.
Qi Lin, Phillip B. Gibbons, Jovan Stojkovic et al.· 0 citations
MRT generates memory restoration templates from the learned sequence of pages that incur page faults during a warm start and uses them to bulk-restore pages using Intel's In-Memory Analytics Accelerator (IAA), avoiding costly on-demand faults.
Aravinda Prasad, S. Subramoney, Sandeep Kumar et al.· Proceedings of the 4th Works...· 0 citations
DynamoServe is presented, a multi-tenant LLM serving framework that addresses challenges through three key innovations: leveraging stranded GPU memory to offload model weights and KV caches, mitigating resource fragmentation in multi-workload environments, and improving memory locality through coordinated data placemen...
Diman Zad Tootaghaj, Khaled Diab, Bob Lantz et al.· Conference on Applications,...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
