Skip to content
Open access

G-CasDec: General Cascaded Decompression on GPUs

Sep 2026 · Proceedings of the ACM on Management of Data · Vol 4, pp. 1-26 · 0 citations · 24 references

TL;DR

G-CasDec is presented, an optimized framework to enable efficient decompression on GPUs for general cascaded compression schemes that outperforms state-of-the-art designs with 2.8× higher compression ratios and 2.0× faster decompression, and is also extensible to arbitrary cascade schemes.

Abstract

GPU-accelerated analytical query processing is often limited by both GPU device memory capacity and host-to-device data transfer time. Modern data compression techniques, such as cascaded lightweight compression, can mitigate these issues. However, existing designs all exhibit critical tradeoffs on compression ratios, decompression speed, and extensibility. They either apply aggressive compression without addressing execution irregularity, or maintain strictly aligned data layouts that sacrifice compressibility. Also, none of them provides an extensible way to easily add new schemes. To address these issues, we present G-CasDec, an optimized framework to enable efficient decompression on GPUs for general cascaded compression schemes. G-CasDec incorporates several key techniques, including aligned batching for aggressive compression of variable-length data yet with efficient decompression, shared memory reuse and register-level fusion to improve resource utilization, and a set of bytecode instructions to orchestrate a generic decompression flow. G-CasDec outperforms state-of-the-art designs with 2.8× higher compression ratios and 2.0× faster decompression, and is also extensible to arbitrary cascade schemes.

Read PDF

Similar papers

Preprint Oct 2026

Tile-Based Decompression in Compiled GPU Engines

Modern GPUs reach record analytical performance only when a query's working set fits within its GPU memory budget, and that budget is under growing pressure: GPUs are partitioned and shared, working sets are outgrowing high-bandwidth memory (HBM), and HBM is a fixed on-device resource whose per-dollar capacity has stag...

Antonio Boffa, Ananya Gupta, Hamish Nicholson et al. · 0 citations
Open access Sep 2026

DCSR-GCN: A High-Performance GCN Accelerator Based on Dynamic Compression and Sparsity Reordering

DCSR-GCN, a high-performance GCN accelerator based on dynamic compression and sparsity reordering based on dynamic compression and sparsity reordering, is presented and a two-phase reordering algorithm that combines conflict-aware row scheduling with reuse-aware column grouping is proposed, thereby mitigating RAW confl...

Jun-Sheng Chang, Yi-Min Zhao, Yu-Xin Huang et al. · 0 citations
Open access 2026

ComPIM: A Processing-in-Memory Accelerator for Compressed DNNs without Decompression

: The increasing size and complexity of modern deep neural networks (DNNs) introduce significant challenges for deployment on resource-constrained embedded systems. Though the quantization techniques reduce memory usage and computational complexity by replacing high-precision parameters with low-precision counterparts,...

Young Seo Lee · 0 citations
Book Open access 2027

Breaking the Tradeoff: Elastic and Isolated GPU Sharing with GVM

GPUs are expensive resources but often underutilized. This inefficiency is exacerbated by the increasing diversity of AI workloads, where small or specialized models often fail to saturate high-capacity devices, necessitating GPU sharing. Existing sharing approaches force a hard tradeoff. They either partition hardware...

Yi-Cheng Liu, Yi-Fan Qiao, Tian Xia et al. · 0 citations
Book Open access Dec 2025

Cerium: A Multi-GPU Framework for Terabyte-Scale Encrypted Inference

Encrypted AI using fully homomorphic encryption (FHE) enables inference directly over encrypted queries, providing strong privacy guarantees. However, its computational and memory overheads have limited practical deployment. Custom FHE accelerators improve performance, but rely on advanced manufacturing technologies th...

Siddharth Jayashankar, Joshua Kim, Michael B. Sullivan et al. · 11 citations · ⚡1
Sep 2026

MaestroRAG: Orchestrated Pipeline Architecture for Efficient RAG on Edge Devices

Retrieval-Augmented Generation (RAG) offers a compact yet powerful alternative to massive Large Language Models (LLMs), making it attractive for privacy- and resource-constrained edge deployments. However, orchestrating RAG on devices with limited compute, memory, and power is nontrivial. We address this challenge with...

Deeksha Chaudhary, Cyan Subhra Mishra, Rishabh Jain et al. · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.