of the 24th USENIX Conference on File and Storage Technologies
SolidAttention is introduced, an LLM inference engine which addresses limitations through a tight co-design of dynamic attention sparsity algorithms and SSD-based storage management and minimizes SSD-induced blocking latency.
Xin Zheng, Dong-Liang Wei, Jian-Xiang Gao et al.
· 0 citations