CFLoRA: Federated Fine-tuning of LLMs with Complementary Factors for Error-free Aggregation
CFLoRA is presented, a federated LoRA scheme that partitions latent LoRA channels into two complementary sets in every communication round, and eliminates bilinear terms in matrix multiplications, making federated aggregation exact.