Preprint
Sep 2026
HBFlex: A Flexible Memory System for Bridging Fine-Grained LLM States and Coarse-Grained HBF Parallel Execution
HBF memory system HBFlex, a full-HBF memory system with coordinated optimizations for KV reads, writes, and reclamation, is presented, benefiting from higher HBF bandwidth and more efficient management of dynamic KV-cache reads, writes, and erases.
Shu-Zhang Zhong, Wei-Kai Xu, Yi-Fan Zhou et al.
· 1 citation