Zhan-Hong Jiang

Personalized Federated Direct Preference Optimization via LoRA Adapters

Federated Direct Preference Optimization (FedDPO) enables privacy-preserving alignment of language models across distributed agents without centralizing sensitive preference data. However, existing FedDPO analysis assumes all clients converge to a single shared policy, which is fundamentally at odds with the heterogene...