Skip to content
Conference

Improving Federated Learning under Non-IID Data through Clustered Ensembles and Adaptive Client Selection

Jul 2026 · International Conference on Edge Computing [Services Society] · pp. 235-240 · 0 citations · 13 references

Abstract

Federated Learning (FL) enables collaborative model training without sharing raw data, but its effectiveness degrades under Non-IID client data and inefficient participation. In such settings, FedAvg may exhibit slow convergence, high variance across rounds, and elevated communication overhead. We propose a clustered ensemble framework to improve training stability and communication efficiency under label-skewed Non-IID distributions. Clients are clustered by data similarity, and one model is trained per cluster. At inference time, we employ a confidence-based ensemble that selects (or combines) cluster models, while adaptive client selection regulates participation within clusters to reduce redundant communication. Experiments on MNIST, Fashion-MNIST, CIFAR-10, and SVHN show more stable learning dynamics and lower communication cost while maintaining competitive accuracy compared to FedAvg. We also analyze how participation policies affect convergence behavior and client fairness.

View source

Similar papers

2025

A Fair Federated Learning Method for Handling Client Participation Probability Inconsistencies in Heterogeneous Environments

This work proposes PHP-FL, a novel model-heterogeneous FL method that explicitly addresses scenarios with varying client participation probabilities to enhance both model accuracy and performance fairness, and introduces a Dual-End Aligned ensemble Learning (DEAL) module.

Siyuan Wu, Yongzhe Jia, Haolong Xiang et al. · 1 citation · ⚡1
Preprint Aug 2026

Assessing the Impacts of Imperfect Datasets on Client Selections in Federated Learning

This study experimentally measures the impact of non-IID data, noisy data, and fairness in client selection on model accuracy and convergence, and proposes a privacy-preserving scoring method to assess each client's contribution in FL.

Yuan-Heng Tsai, Li-Hsing Yen, Yan-Wei Chen · 0 citations
Conference Jul 2026

Coalitional Game-Based Clustered Federated Learning for Mitigating Data Heterogeneity in Wireless Networks

Federated Learning (FL) has emerged as a promising paradigm for privacy-preserving distributed machine learning across mobile and edge devices. Nevertheless, the presence of non-independent and identically distributed (non-IID) data in wireless networks often leads to severe gradient divergence, slow convergence, and d...

Yu-Wei Chan, Jhih-Yu Tsai, Feng-Tsun Chien · 0 citations
Preprint Aug 2026

Beyond Parameter Space: NTK-Guided Personalized Aggregation for Robust Federated Learning

Local Inference Guided Aggregation for Heterogeneous Training Environments to Yield Enhancement Through Agreement and Regularization (LIGHTYEAR), a federated learning framework that performs update selection in function space using an NTK-based agreement score to characterize predictive behavior and determine a persona...

Mirko Konstantin, S. Zachow, Anirban Mukhopadhyay · 0 citations
Aug 2026

Prototype-based federated learning for one-time soft clustering

Experiments under representative Non-IID settings on benchmark datasets show that PFLS-One achieves improved accuracy and faster convergence compared with representative baseline methods, and the convergence analysis under a non-convex objective provides theoretical support for the proposed method.

Ping Xie, Xiang-Rui Gao, Jingyan Wu et al. · 0 citations
Review Open access Jul 2026

A Fairness Perspective on Client Selection and Aggregation Methods for Non-IID Mitigation in Federated Learning: A Survey

This survey aims to provide a structured perspective on the relationship between non-IID mitigation and fairness and support the development of more balanced and scalable FL systems under non-IID conditions.

Mohannad Alsofyani, Isra Al-Turaiki, H. Mathkour · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.