Skip to content

Efficient Resource Optimization for Split Federated Learning

Aug 2026 · 0 citations · 43 references
Computer Science

TL;DR

This work establishes an efficient optimization framework for SFL under resource-constrained networks that jointly optimizes model splitting and resource allocation to minimize training cost, which is defined as the weighted sum of latency and energy costs.

Abstract

Split federated learning (SFL) has emerged as a powerful paradigm for model training at the edge. However, SFL inherently involves discrete decision variables for model splitting and resource allocation, resulting in a challenging mixed-integer problem. Consequently, prior optimization schemes for SFL are either \textit{heuristic} or \textit{computationally inefficient}, which cannot handle large-scale user populations. To address this limitation, this work establishes an efficient optimization framework for SFL under resource-constrained networks. Our framework jointly optimizes model splitting and resource allocation to minimize training cost, which is defined as the weighted sum of latency and energy costs. We first study the model splitting problem and develop a polynomial-time algorithm that achieves the global optimum. Then, we extend the approach to the joint model splitting and resource allocation problem. In this case, we formulate it as a two-dimensional master problem and develop an efficient approximation method with a $(1+\epsilon)$-approximation guarantee. Extensive experiments show that the proposed approach provides efficient solutions to strike the optimal energy--latency tradeoff.

View source

Similar papers

Preprint Aug 2026

A Momentum-Based Variance-Reduced Algorithm for Federated Multiobjective Optimization

A momentum-based variance-reduced algorithm for federated multiobjective optimization that incorporates a momentum-driven gradient estimator into the local updates to reduce the variance of stochastic updates, leading to an improved convergence rate.

Yong Zhao, Chunlin You, M. N. Dao et al. · 0 citations
2026

AdaSplitLoRA: Adaptive Split Federated Learning for Efficient LLM Fine-Tuning in Wireless Networks

This letter proposes Adaptive Split LoRA (AdaSplitLoRA), a framework that jointly optimizes adaptive low rank adaptor (LoRA) rank allocation and dynamic bandwidth allocation for communication-efficient split federated learning (SFL)-based large language model (LLM) fine-tuning. We formulate a joint per-round latency mi...

HyunJun Choi, Joohyung Lee, Ronald Y. Chang · 0 citations
Preprint Aug 2026

Adaptive Heterogeneous Compression for Resource-Efficient Federated Knowledge Distillation

A heterogeneous compression framework for FedKD is proposed that enables each client to select a compression strategy from a candidate strategy set, and an Adaptive heterogeneouS Compression algorithm for fEderated kNowledge Distillation (ASCEND), which employs an exponential moving average (EMA)-enhanced $\epsilon$-gr...

Chen-Wang Liu, Yijun Liu, Chang Liu et al. · 0 citations
Preprint Aug 2026

FEAST: Federated Shared-Space Training for Resource-Heterogeneous Clients

FEAST is proposed, a federated shared-space training framework that counters this imbalance by jointly training multiple subnetworks within each client's limit by introducing a one-parameter $\gamma$-allocation protocol to control this coupling.

Bostan Khan, Masoud Daneshtalab · 0 citations
Aug 2026

Hybrid optimization framework of federated learning of multi-models in edge networks: trade-off of energy, latency, and fairness

A new hybrid decomposition approach for optimizing multi-model federated learning (MMFL) in edge computing environments that enhances the speed of convergence, contention of resource, and real-time performance, which makes it especially appropriate to apply it to the real-world, e.g., smart healthcare, autonomous vehic...

M. Grace, N. Brintha · 0 citations

Related blog posts

Microsoft Research Blog Oct 12, 2026

Simulating student learning for better AI tutoring

StudentSim is a research system for evaluating and improving AI tutoring tools before they are tested with learners. It models how individuals may engage with tutors, giving feedback to improve tutor performance across subjects like chess, writing, and mathematics. The post Simulating student learning for better AI tutoring appeared first on Microsoft Research.

We use cookies to run the site and, with your consent, for analytics and to show ads. See our Cookie Policy.