Skip to content
Conference

A Survey on Caching Systems in Serverless Computing

Jul 2026 · International Conference on Ubiquitous and Future Networks · pp. 762-764 · 0 citations · 10 references

Abstract

Serverless computing, particularly Function-as-aService (FaaS), has emerged as a dominant cloud computing paradigm offering automatic scaling, pay-per-use pricing, and simplified deployment. However, the stateless and ephemeral nature of serverless functions introduces significant performance challenges, most notably cold-start latency and costly remote data access. Caching has been widely recognized as a key technique to mitigate these issues, yet the unique constraints of serverless environments-such as ephemeral containers, limited local state, and multi-tenant resource sharing-demand fundamentally new caching designs. In this paper, we present a concise survey of five representative caching systems for serverless platforms published between 2021 and 2025. We categorize them into three classes: container-level caching for cold-start mitigation, datalevel caching for reducing storage access latency, and cache coherence mechanisms for distributed consistency. We compare these systems along key dimensions including caching granularity, eviction strategy, transparency, and performance gains. Finally, we identify open challenges and promising directions for future research.

View source

Similar papers

Book Open access Jul 2026

FaaSlim: Partial Caching of Snapshot-based VMs for Serverless Computing

FaaSlim is proposed, a snapshot-based serverless computing system that integrates both in-memory caching and snapshot-based in-storage caching to reduce cold start latency, and devise a partial caching-aware eviction policy, GDSF-CE, which selects VMs and page subsets to evict based on cache efficiency.

Sanghyeon Eom, Chanyoung Park, Gihong Lee et al. · 0 citations
Open access Aug 2026

CELLServe: An SLO-Aware and Cost Efficient LLMs Serving System for Serverless Computing Environments

CELLServe formalizes SLO-constrained joint resource provisioning as an optimization problem with a dedicated algorithm, and introduces an opportunistic instance merging strategy for decode phase functions to reclaim fragmented resources.

Zejian Wang, Nan Lin, Zinuo Cai et al. · 0 citations
Preprint Aug 2026

CacheRoute: Planned Prefix-Affinity Routing for Large-Scale LLM Serving

When affinity recovers too little KV work, its residual load skew reduces or erases the improvement, so gating any deployment with a shadow replay rather than enabling affinity from workload statistics alone is recommended.

Huang Cheng · 1 citation
Conference Open access May 2026

STORE: Self-Provisioning Storage-as-a-Service for Serverless Functions

STORE automatically selects the optimal storage backend and eliminates developer effort through zero-touch and zero-configuration provisioning, achieved by moving the self-provisioning logic to the platform level.

Florian Trimmel, Cynthia Marcelino, T. Pusztai et al. · 0 citations
Open access 2023

Optimizing Cloud Storage Using Intelligent Caching Algorithms

The findings support the fact that smart caching schemes offer a solid and scalable remedy to optimization of next-generation cloud storage.

Carlos Mendes · 0 citations
Conference Jul 2026

An Intelligent Content Caching for NDN with Communication-Efficient State Sharing

The built-in caching capability of Named Data Networking (NDN) is one of the most transformative proposals of next-generation network architecture, as it simultaneously realizes network traffic reduction, resilience to node failures, and prompt data retrieval. However, existing caching policies either make too many cac...

Deep Pradipbhai Shah, Sai Sameer Yanamandra, Siva Girish Ramesh et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.