A federated random walk averaging framework is proposed, which is a variant of federated averaging (FedAvg) that mitigates data heterogeneity by updating models along random walk (RW) paths and aggregating them at the server and reduces the problem to a general form agnostic to task type and model architecture.
Abstract
In wireless federated learning (FL), data heterogeneity and multiple local updates induce client drift, degrading model convergence. It is further affected by unreliable wireless links, as transmission errors may invalidate model updates. To address these challenges, we propose a federated random walk averaging (FedRW) framework, which is a variant of federated averaging (FedAvg) that mitigates data heterogeneity by updating models along random walk (RW) paths and aggregating them at the server. Model parameters are transmitted in packets with retransmission support to improve training quality by mitigating wireless errors along RW paths. Meanwhile, wireless transmission delays hinder the exploration of FedRW. To this end, we formulate a joint optimization problem that integrates learning, RW path selection, and transmission parameter tuning, aiming to minimize the training loss under delay constraints. By deriving an upper bound on the expected convergence of FedRW over unreliable wireless networks, we reduce the problem to a general form agnostic to task type and model architecture. A distributed solution is then proposed, in which the server or clients optimize packet size and maximum number of retransmissions locally, and efficiently select reliable and expandable next-hop nodes via a resilience-aware beam search with dynamic pruning. Simulation results show that FedRW achieves 2.26%-9% higher accuracy than state-of-the-art baselines under high data heterogeneity. Furthermore, the jointly optimized FedRW yields at least 2.78% higher accuracy and faster convergence compared to baselines.
Over-the-air computation has emerged as a scalable and efficient solution for deploying federated learning algorithms in wireless networks by exploiting waveform superposition for simultaneous model aggregation. Most existing work struggles with heterogeneous fading channels. These approaches either enforce unbiased up...
Ming Xiang, Nicolò Michelusi, Y. Eldar et al.· 0 citations
Experimental results on heterogeneous MNIST and CIFAR-10 settings show that QEF-GT-AdamW consistently improves robustness and convergence performance over representative DecL baselines while achieving favorable accuracy-communication trade-offs under limited wireless resources.
Thieu Van Nguyen, T. Nguyen, Ons Aouedi et al.· 0 citations
Federated learning (FL) enables multiple devices to collaboratively train a global model without sharing local data. However, due to limited local computing capability and communication bandwidth, FL suffers from high learning latency, especially when the model size is large. To address these issues, we propose APQ-FL,...
Xiao-Dong Li, Yulong Gao, C. Chiasserini et al.· IEEE Transactions on Cogniti...· 0 citations
FedPGT, a progressive gradient transmission scheme for VFL over time-varying channels, where vehicles progressively transmit high-magnitude gradient entries in response to instantaneous channel conditions is proposed, establishing a convergence bound that characterizes the impact of transmitted gradient entries and rev...
Jin-Tao Yan, Tan Chen, Yuxuan Sun et al.· 0 citations
A comprehensive system model is established that jointly incorporates the convergence behavior of the FUN algorithm, local device computation dynamics, and a worst-case robust transmission model operating under bounded channel state information (CSI) error to solve the resulting non-convex joint resource allocation pro...
Yi-Xuan Chen, Zhou-Xiang Zhao, Wei Xu et al.· 0 citations
The rapid advances in wireless communication technologies have driven the adoption of distributed artificial intelligence in next-generation wireless networks. However, traditional centralized learning approaches become increasingly inefficient due to limited communication bandwidth, stringent latency constraints, and...
Nifty Fath, I. G. D. Nugraha, Muhamad Asvial· IEEE Open Journal of the Com...· 0 citations
Exploring how generative AI could make machine vision more accessible to businesses. The post GenEye in a Box: Making Machine Vision Something You Can Just Ask For appeared first on GPT-Lab.
MIT News · Artificial Intelligence· news.mit.eduOct 7, 2026
Students in MIT’s Concourse program delve deeply into the human condition, debate challenging questions, and learn to develop judgment about issues that can’t be quantified.
Training AI agents with reinforcement learning can be challenging because their tools, context, and decision-making are managed by complex frameworks. Agent Lightning connects existing agents to RL training, making it easier to improve them without rebuilding them. The post Agent Lightning v1.0: A 3,500-Line Lightweight Agentic RL Framework for Training Agents with Real Harnesses appeared first on Microsoft Research.
MIT News · Artificial Intelligence· news.mit.eduOct 6, 2026