Preprint
Aug 2026
FlashBoot: Sub-Second Weight Loading for Large Models at Rack Scale
FlashBoot is presented, a hardware-friendly, framework-workflow co-designed weight-loading subsystem built on SGLang that accelerates single-node weight loading by up to 50x and concurrent rack-level weight loading by>270x and scales poorly to concurrent multi-node bring-up.
Issac Zhu, Hscos Zhang, Ke Jiang et al.
· 0 citations