Skip to content
Open access

Prompt transfer for few-shot fault diagnosis in IIoT: a federated learning framework with tabular foundation models

Aug 2026 · Measurement science and technology · Vol 37 · 0 citations · 40 references
Physics

Abstract

In industrial internet of things (IIoT) deployments, condition monitoring data is rarely complete. Labeled samples are scarce, sensors drop out, signals are corrupted by noise, and what reaches the edge is often a sparse, distorted fragment of the ideal dataset. Federated learning preserves privacy, yet its standard formulations assume clients can train locally on adequate labeled data-an assumption that seldom holds on the factory floor. This paper proposes prompt transfer, a distinct federated learning paradigm that replaces conventional gradient or prototype exchange with the transfer of small, curated sets of labeled examples (prompts) as the sole medium of knowledge flow. Unlike federated distillation, which shares model outputs, or meta-learning, which requires local gradient adaptation, prompt transfer leverages the in-context learning capability of a frozen tabular foundation model to achieve zero-gradient, parameter-free knowledge transfer across clients. Experiments on the Southeast University bearing dataset show that under 5-shot settings, our method FedICL achieves 94.0% accuracy, in contrast to FedAvg’s random-guessing performance of 20.1% while requiring zero gradient computation and reducing communication rounds by 95% and data transfer by 87%. The approach remains effective under non-IID distributions ( 53.9% vs 20% random). This work directly addresses the special issue themes of incomplete data and federated learning, offering a practical solution for label-scarce, resource-constrained IIoT scenarios.

Read PDF

Similar papers

Conference Jun 2026

FedOPAL: One-Shot Federated Learning via Analytic Visual Prompt Tuning

Experimental results show that FedOPAL not only significantly outperforms the original analytical methods on several benchmarks, but also achieves accuracy comparable to state-of-the-art iterative methods while maintaining zero server-side training costs, providing a new engineering paradigm for efficient collaboration...

Lingyu Qiu, Daniela Annunziata, Stefano Izzo et al. · 0 citations
Jul 2026

Collaborative Synthetic Data Generation for Knowledge Transfer in Federated Learning

FedKT-CSD (Federated Knowledge Transfer via Collaborative Synthetic Data), a framework inspired by neural image compression that closes the gap in jointly achieving low communication, robustness to heterogeneity, and rigorous privacy by leveraging publicly pretrained autoencoders as a shared latent space.

Maximilian Andreas Hoefler, Karsten Mueller, Wojciech Samek · 0 citations
Preprint Aug 2026

FedADB: Class Anchor-Driven Dual-Branch Federated Learning for Mitigating Forgetting

FedADB, a Class Anchor-Driven Dual-Branch FL framework, a dual-branch collaborative training mechanism designed for clients that achieves significant improvements in both accuracy and convergence speed.

Zhenyan Liu, Hua Zhang, Haoran Gao et al. · 0 citations
2025

Rising from Ashes: Generalized Federated Learning via Dynamic Parameter Reset

A novel FL framework is presented, FedPhoenix, that stochastically re-sets partial parameters in each round to destroy some features of the global model, guiding FL training to learn multiple generalized features for inference rather than specific overfitting features.

Jia-Hao Wu, Ming Hu, Yanxin Yang et al. · 1 citation
Jul 2026

Regularization-Enhanced Federated Class-Incremental Learning with Generative Replay for Smart Edge

This work proposes RAVEL-FCL, a generative replay-based framework for federated continual learning that integrates an improved generative model based on Rebooting ACGAN with multi-level feature alignment to ensure consistency and employs Elastic Variational Continual Learning on the server to probabilistically regulari...

Yurui Zhou, Jia Hu, G. Min et al. · 0 citations

FedProIn: Mitigating Client Drift for Learnable Prototypes in Federated Medical Imaging

This work proposes a prototype-based, influence-aware federated learning framework (FedProIn) that uses multiple learnable class prototypes to capture shared semantic structures across heterogeneous clients and introduces feature divergence loss and prototype contrastive loss to mitigate client drift by decomposing it...

Harsh Kumar, T. Garg, V. Sundaresan · 0 citations

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.