Publication
Towards Decentralized Parameter Servers for Secure Federated Learning
Muhammad El-Hindi; Zheguang Zhao; Carsten Binnig
In: Alfredo Cuzzocrea; Oleg Gusikhin; Wil M. P. van der Aalst; Slimane Hammoudi (Hrsg.). Proceedings of the 11th International Conference on Data Science, Technology and Applications. International Conference on Data Science, Technology and Applications (DATA-2022), July 11-13, Lisbon, Portugal, Pages 257-269, SCITEPRESS, 2022.
Abstract
Federated learning aims to protect the privacy of data owners in a collaborative machine learning setup since training data does not need to be revealed to any other participant involved in the training process. This is achieved by only requiring participants to share locally computed model updates (ie, gradients), instead of the training data, with a centralized parameter server. However, recent papers have shown that privacy attacks exist which allow this server to reconstruct the training data of individual data owners only from the received gradients. To mitigate this attack, in this paper, we propose a new federated learning framework that decentralizes the parameter server. As part of this contribution, we investigate the configuration space of such a decentralized federated learning framework. Moreover, we propose three promising privacy-preserving techniques, namely model sharding, asynchronous updates and polling intervals for stale parameters. In our evaluation, we observe on different data sets that these techniques can effectively thwart the gradient-based reconstruction attacks on deep learning models, both from the client side and the server side, by reducing the attack results close to random noise.