Adaptive Phase-Switching for Communication-Efficient Federated LoRA Fine-Tuning
This paper measures per-round upload and download bytes for a bidirectional B-only federated LoRA protocol and places five methods, three from prior work, on a single communication-quality frontier and finds ReverseAdaptive outperforms FFA-LoRA on TinyLlama-1.1B-Chat with Alpaca.
Jerry Adams Franklin
· 0 citations