PNFR: practicality-enhanced and non-interactive privacy-preserving federated regressions

Abstract

Federated learning is a technology that is used to protect data privacy in machine learning. Nonetheless, in federated learning, updating the global model requires the use of gradient descent algorithm, which involves multiple rounds of interaction between entities to complete the iterative updates, inevitably incurring massive computational and communication overhead. In 2020, Wang et al. first proposed a non-interactive federated regression scheme, which effectively improves the training efficiency of regression models while protecting the privacy of local training data. However, like most current federated regressions, it involves a third authority (TA) to generate keys for each entity, which poses a significant privacy risk and results in considerable communication overhead. From the view of security and practicality, this paper first proposes a multi-party homomorphic encryption algorithm named MPaillier. Furthermore, we have designed PNFR, a privacy-preserving federated learning scheme for regressions training built on the MPaillier algorithm. The participating entities of PNFR are the data owners and a cloud server, eliminating the need for a TA, thus enhancing the practicality and efficiency of the scheme. Experimental results demonstrate that our scheme is $\sim 10^{3}$ times faster than interactive federated regressions PrivFL and about 80% faster than non-interactive federated regressions VANE.