Yi-Hang Wu

FedENC: Federated Adaptive CLIP Model via Energy Alignment and Neural Collapse

This work proposes FedENC, a novel federated adaptive CLIP framework that keeps the CLIP encoder frozen and introduces a lightweight communicable global expert adaptation module for learning general knowledge across clients and two local experts for client-specific adaptation to reduce computation and communication ove...