Ditto: Online Memory Rightsizing and Value-Aware Eviction for Reducing Cold Starts in Serverless Platforms
Modern serverless platforms create function instances based on user-specified memory limits, which often result in memory over-provisioning even when the average runtime footprint is small. This over-provisioning reduces warm container density under a fixed memory budget, leading to early pool saturation, frequent evic...