The heterogeneous nature has been regarded as a predominant challenge during the deployment of federated learning (FL) systems, wherein model heterogeneity—where clients train models of fundamentally different architectures—remains underexplored. Existing methods tolerate it poorly: they enforce interdependent model families, extract sub-models of one shared model, or rely on auxiliary public datasets and proxy models, which constrain model selection or demand storage that resource-limited clients cannot afford. We posit that an effective bridge across heterogeneous models should be both model-agnostic—decoupling knowledge transfer from incompatible parameter spaces—and storage-free, staying practical for clients with sharply different resources. On this basis we propose FedGPA, a hierarchical framework in which clients with comparable resources and identical architectures form a group and a server mediates knowledge transfer across groups of diverse models; at its core, the lightweight, model-agnostic Aligned Co-decision (Alco) Unit aligns class-level prototypical information across groups to bridge heterogeneous architectures, and a prototypical fusion step interpolates prototypes to regularize local training and refine cross-group knowledge. Experiments on CIFAR-10/100, EMNIST, and Tiny-ImageNet across heterogeneous architectures show that FedGPA consistently outperforms strong baselines from four method families, with the largest gains on resource-poor clients, at a cost of only ~100 KB of additional cross-group communication per round. A limitation of this study is that we provide no formal differential-privacy guarantee for the exchanged prototypes and do not address adversarial or data-quality attacks, leaving both to future work.
Liyinglan Liu, Zikai Xiao, Zihan Chen et al.· Journal of Machine Learning...· 0 citations
LDT-Coord is proposed, a networked coordination framework built upon a lightweight digital twin that achieves a task success rate comparable to conventional coordination methods while reducing communication overhead by more than 70x and maintaining robustness under LLM heterogeneity.
A systematic survey of media communication technologies for 6G vision communication is presented by revisiting the evolution of communication and media technologies and clarifying the intrinsic relationship between media content processing and wireless transmission.
Bingyan Xie, Longyu Zhou, Zi-Han Chen et al.· 0 citations
Federated learning (FL) applications normally employ large deep learning (DL) models, resulting in excessive communication overhead in the deployment of FL over resource-constraint mobile edge networks. To achieve better scalability for DL-based FL, we capitalize on both the asymmetric nature of mobile networks and the distinct effects of partial transmissions on FL training for the global and local models. We propose Fed-DynAmal, an FL framework that decreases the number of parameters transmitted in the uplink (clients-to-server) while concurrently achieving better model performance. The underlying idea is that each selected client sends a partial DL model to the server by omitting several sub-blocks from the trained local model. Crucially, we drop the assumption that transmitted local models can still be used for inference, thereby allowing for greater model variability. At the server, we introduce amalgamation, a process to merge different partial local models into an inference-viable full model. Essentially, amalgamation is a bridge for performing aggregation at the sub-block level. Interestingly, as the key takeaway, communication efficiency versus model performance is not necessarily a trade-off in FL: Our extensive experiments show that Fed-DynAmal can effectively improve communication efficiency while still concurrently achieving higher accuracy and enhanced robustness.
Zihan Chen, H. Yang, Tony Q. S. Quek et al.· IEEE Transactions on Cogniti...· 0 citations
We use cookies to run the site and, with your consent, for analytics and to show ads.
See our Cookie Policy.
