FLoKD: Adaptive Knowledge Distillation for Federated Low-Rank LLM over Wireless Networks
Large language models (LLMs) have demonstrated strong capabilities across a wide range of natural language processing tasks. However, conventional fine-tuning typically relies on centralized data collection, bringing in privacy concerns. Federated learning (FL) enables collaborative LLM fine-tuning without sharing raw...
Xin-Lu Zhang, Na Yan, Yang Su et al.
· 0 citations