Skip to content

FedHiPL: Federated Hierarchical Prototype Learning for Heterogeneous Non-IID Data

Sep 2026 · IEEE Internet of Things Journal · Vol 13, pp. 40931-40944 · 0 citations · 39 references
Computer Science

Abstract

Federated learning (FL) collaboratively trains models across networked industrial Internet of Things (IIoT) terminals. However, statistical heterogeneity in IIoT data often hinders the performance of global models. Current FL methods typically focus on single-level representation alignment and fail to exploit gradient-guided semantic feedback across hierarchical layers. To address statistical heterogeneity, we propose federated hierarchical prototype learning (FedHiPL), which models local representations with Gaussian prototypes and improves global learning through hierarchical prototype calibration. First, FedHiPL performs multilevel prototype alignment based on symmetric Kullback–Leibler divergence to enforce representation consistency across layers. Second, FedHiPL calibrates the local decision head by balancing local and global decision objectives with decision consistency constraints. Third, FedHiPL rectifies global prototypes through a gradient-guided hierarchical calibration module to maintain structural consistency across network layers. Experiments on a custom-constructed distributed cluster demonstrate that FedHiPL achieves 93.24% accuracy on Edge-IIoT and 72.36% accuracy on UNSW-NB15 under strong statistical heterogeneity, outperforming the representative prototype-based baseline FedProto by 6.06% and 15.80%, respectively.

View source

Similar papers

Conference Aug 2026

FedLEAF: Bi-directional Prototype Adaptation for Heterogeneous Federated Learning

Prototype-based knowledge sharing effectively mitigates data and model heterogeneity in federated learning (FL) by exchanging class-level semantic information. However, existing methods typically assume all local prototypes are equally reliable. Consequently, low-quality prototypes from heterogeneous models or dynamic clients can contaminate the global aggregation, leading to a vicious cycle of noise accumulation and performance degradation. To address this, we propose FedLEAF, a Federated Learning framework with server-side proactive Evaluation and clientside Adaptive Fusion. Specifically, the server employs an Adaptive Learning Prototypes (ALP) network to dynamically evaluate prototype reliability and generate learnable aggregation weights, ensuring that highquality prototypes exert a primary influence on the global model. Meanwhile, the client utilizes a Historical Consistency Fusion (HCF) strategy to selectively absorb global knowledge by assessing its consistency with locally maintained historical prototypes. Extensive experiments on standard datasets demonstrate that FedLEAF achieves effective improvements in model accuracy and robustness compared to existing methods.

Zhiyuan Zhu, Si-Yi Deng, Dapeng Wu et al. · 0 citations
Jul 2026

FedTopo: Relation-Level Topology Sharing for Model-Heterogeneous Federated Learning

FedTopo is proposed, a relation-level framework that encodes global knowledge as class relation topology, capturing how classes relate within each client rather than where they lie in feature space.

Zhaoyang Ma, Zhihao Wu, Xin Gao et al. · 0 citations
Aug 2026

Prototype-based federated learning for one-time soft clustering

Experiments under representative Non-IID settings on benchmark datasets show that PFLS-One achieves improved accuracy and faster convergence compared with representative baseline methods, and the convergence analysis under a non-convex objective provides theoretical support for the proposed method.

Ping Xie, Xiang-Rui Gao, Jingyan Wu et al. · 0 citations
2025

FedLPA: Local Prior Alignment for Heterogeneous Federated Generalized Category Discovery

Federated Generalized Category Discovery (Fed-GCD) aims to train a global model that classifies seen classes while discovering novel ones from data distributed across heterogeneous clients. Existing GCD methods often rely on unrealistic assumptions, such as prior knowledge of the number of novel classes or balanced class distributions across clients. We propose Federated Local Prior Alignment (FedLPA), which eliminates these assumptions by grounding learning in client-specific structures and aligning predictions with locally derived priors. Specifically, each client constructs a similarity graph refined with high-confidence signals from seen classes, and then identifies local concepts and prototypes via Infomap clustering. Building on these discovered structures, we introduce Local Prior Alignment (LPA), a self-distillation mechanism that aligns batch-level predictions with empirical class prior derived from concept assignments. Through iterative local structure discovery and adaptive prior refinement, FedLPA achieves robust generalized category discovery under severe data heterogeneity. Extensive experiments demonstrate that FedLPA significantly outperforms existing federated GCD methods across both fine-grained and standard benchmarks.

Geeho Kim, Jinu Lee, Bohyung Han · 1 citation
Open access Aug 2026

FedA2L: Adaptive layer-wise learning rate adjustment in decentralized federated learning

Decentralized intelligence systems with heterogeneous devices and limited coordination increasingly rely on decentralized federated learning (DFL). However, DFL suffers from convergence inefficiency under data heterogeneity due to the use of a uniform learning rate (LR) that ignores layer-specific optimization needs. Foundational layers are responsible for maintaining network consensus, while specialized layers adapt to local data characteristics, leading to conflicting gradients and degraded performance under non-IID conditions. To address this fundamental tension, this work introduces FedA2L, a method that dynamically adjusts layer-wise LRs based on model divergence signals. By leveraging local update intensity and network consensus constraints, FedA2L seamlessly integrates into existing DFL protocols without additional communication or coordination. Extensive evaluations across DFL algorithms, various model architectures, and datasets demonstrate that FedA2L achieves up to 4.94 times faster convergence than vanilla DFL and reduces communication rounds by up to 59% compared to scheduler-based baselines. Furthermore, FedA2L exhibits resilience to severe data heterogeneity, larger network sizes, and sparse topologies, reducing communication overhead and establishing it as a versatile optimization tool for resource-constrained or large-scale distributed learning in edge and IoT deployments. The code is released at https://github.com/nclabteam/FedA2L.

V. T. Vo, K. Nguyen, Taehong Kim · 0 citations

Related blog posts

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.