Delphinus is an ultra-fast link failure detection and recovery solution built on the data-plane of programmable switches that achieves ultra-fast failure detection via hardware-based port state monitoring, extends recoverable failure coverage through remote failure notification and relay, and enables fast recovery by p...
Junye Zhang, Jie Li, Zhigang Ji et al.· Conference on Applications,...· 0 citations
Dragonfly-Ultra is presented, a scalable, low-cost network architecture for high-performance AI clusters that can scale to over 260k GPUs with only 82% cost and 81% power consumption of a 3-layer Clos architecture and incorporates three key mechanisms to further improve network performance and optimize collective commu...
Rui Zhuang, Hui Yuan, Junye Zhang et al.· Conference on Applications,...· 0 citations
Prefix caching has become a key technique for LLM serving, and nowadays the reusable KVCache contents are often hosted on distributed servers. For long-context LLM inferences with high cache hit ratio, cross-server KVCache transmission has become an emerging performance bottleneck; such network-intensive LLM inferences...
Weiye Wang, Chen Chen, Junxue Zhang et al.· Asia-Pacific Workshop on Net...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
