With the explosive growth of personal data in the era of big data,federated learning has broader application prospects,in order to solve the problem of data island and preserve user data privacy,a federated learning m...With the explosive growth of personal data in the era of big data,federated learning has broader application prospects,in order to solve the problem of data island and preserve user data privacy,a federated learning model based on differential privacy(DP)is proposed.Participants share the parameters after adding noise to the central server for parameter aggregation by training local data.However,there are two problems in this model:on the one hand,the data information in the process of broadcasting parameters by the central server is still compromised,with the risk of user privacy leakage;on the other hand,adding too much noise to parameters will reduce the quality of parameter aggregation and affect the model accuracy of federated learning finally.Therefore,a novel federated learning approach with bidirectional adaptive differential privacy(FedBADP)is proposed,it can adaptively add noise to the gradients transmitted by participants and central server,and protects data security without affecting model accuracy.In addition,considering the performance limitations of the participants’hardware devices,this model samples their gradients to reduce communication overhead,and uses RMSprop to accelerate the convergence of the model on the participants and central server to improve the ac-curacy of the model.Experiments show that our novel model can not only obtain better results in accuracy,but also enhance user privacy preserving while reducing communication overhead.展开更多
基金This research is funded by the 2022 Central University of Finance and Economics Education and Teaching Reform Fund(No.2022ZXJG35)Emerging Interdisciplinary Project of CUFE,the National Natural Science Foundation of China(No.61906220)Ministry of Education of Humanities and Social Science project(No.19YJCZH178).
文摘With the explosive growth of personal data in the era of big data,federated learning has broader application prospects,in order to solve the problem of data island and preserve user data privacy,a federated learning model based on differential privacy(DP)is proposed.Participants share the parameters after adding noise to the central server for parameter aggregation by training local data.However,there are two problems in this model:on the one hand,the data information in the process of broadcasting parameters by the central server is still compromised,with the risk of user privacy leakage;on the other hand,adding too much noise to parameters will reduce the quality of parameter aggregation and affect the model accuracy of federated learning finally.Therefore,a novel federated learning approach with bidirectional adaptive differential privacy(FedBADP)is proposed,it can adaptively add noise to the gradients transmitted by participants and central server,and protects data security without affecting model accuracy.In addition,considering the performance limitations of the participants’hardware devices,this model samples their gradients to reduce communication overhead,and uses RMSprop to accelerate the convergence of the model on the participants and central server to improve the ac-curacy of the model.Experiments show that our novel model can not only obtain better results in accuracy,but also enhance user privacy preserving while reducing communication overhead.
