Neural processing units (NPUs) provide high compute density and energy efficiency through specialized matrix engines and software-managed on-chip memory. However, their libraries primarily target dense computation. Sparse matrix-dense matrix multiplication (SpMM), a key kernel in graph analytics, sparse neural networks...
Fei Li, Hao-Xin Li, Ke-Hong Liu et al.· 0 citations
Shingled Magnetic Recording (SMR) and Interlaced Magnetic Recording (IMR) technologies significantly increase disk storage density by overlapping internal tracks, but the resulting frequent read-modify-write(RMW) operations can cause severe performance jitter. Building Log-Structured Merge Tree (LSM-tree) based key-val...
Fang-Xing Yu, Zhi-Ke Li, Chi Zhang et al.· ACM Transactions on Architec...· 0 citations
Speculative decoding reduces sequential Target model calls by verifying multiple tokens from the Draft model in parallel. Yet KV Cache growth limits long-context serving under constrained GPU memory. Offloading KV to CPU memory relieves this pressure. However, existing offloading schemes restore the full KV history bef...
Fei Li, Song Liu, Shi-Qiang Nie et al.· arXiv.org· 0 citations
A protocol where each participant simulates multiple virtual users to report target functions through distinct, anonymized messages is proposed, which improves utility for tested multi‐target aggregation tasks compared to representative decentralized DP baselines, simplifies privacy amplification analysis through group...
Sen-Qiao Liu, Wei-Guo Wu, Shaowei Wang et al.· Transactions on Emerging Tel...· 0 citations
OTDB, a key-value store tailored for overlapping track-based Disks is proposed and a Heterogeneous Multi-Granular Zoned Storage scheme that separates Sorted String Tables (SSTables) from different LSM-tree levels and maps them to zones with differentiated characteristics is developed, which reduces zone reset costs and...
Fang-Xing Yu, Zhi-Ke Li, Chi Zhang et al.· ACM Transactions on Architec...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.