SWIFT: Rapid Decentralized Federated Learning via Wait-Free Model Communication
Reference implementation of SWIFT, a wait-free decentralized federated learning algorithm in which clients never block on one another: each broadcasts its model to its neighbours and averages in whatever has arrived. SWIFT is the first asynchronous decentralized federated learning algorithm to obtain the optimal O(1/sq...