Differentially private average consensus with improved accuracy-privacy trade-off

被引:3
作者
Wang, Lei [1 ]
Liu, Weijia [1 ]
Guo, Fanghong [2 ]
Qiao, Zixin [3 ]
Wu, Zhengguang [1 ]
机构
[1] Zhejiang Univ, Coll Control Sci & Engn, Hangzhou, Peoples R China
[2] Zhejiang Univ Technol, Dept Automat, Hangzhou, Peoples R China
[3] Shanghai Inst Comp Technol, Shanghai, Peoples R China
基金
中国国家自然科学基金;
关键词
Differential privacy; Average consensus; Encryption; Gaussian noise; Laplace noise; Accuracy -privacy trade-off; OPTIMIZATION; NOISE; UTILITY;
D O I
10.1016/j.automatica.2024.111769
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper studies the average consensus problem with differential privacy of initial states, for which it is widely recognized that there is a trade-off between the mean-square computation accuracy and privacy level. Considering the trade-off gap between the average consensus algorithm and the centralized averaging approach with differential privacy, we propose a distributed shuffling mechanism based on the Paillier cryptosystem to generate correlated zero-sum randomness. By randomizing each local privacy-sensitive initial state with an i.i.d. Gaussian noise and the output of the mechanism using Gaussian noises, it is shown that the resulting average consensus algorithm can eliminate the gap in the sense that the accuracy-privacy trade-off of the centralized averaging approach with differential privacy can be almost recovered by appropriately designing the variances of the added noises. We also extend such a design framework with Gaussian noises to the one using Laplace noises, and show that the improved privacy-accuracy trade-off is preserved. (c) 2024 Elsevier Ltd. All rights are reserved, including those for text and data mining, AI training, and similar technologies.
引用
收藏
页数:10
相关论文
共 36 条
[1]   A system-theoretic framework for privacy preservation in continuous-time multiagent dynamics [J].
Altafini, Claudio .
AUTOMATICA, 2020, 122
[2]  
Balle B, 2018, PR MACH LEARN RES, V80
[3]   The Challenge of Real-Time Multi-Agent Systems for Enabling IoT and CPS [J].
Calvaresi, Davide ;
Marinoni, Mauro ;
Sturm, Arnon ;
Schumacher, Michael ;
Buttazzo, Giorgio .
2017 IEEE/WIC/ACM INTERNATIONAL CONFERENCE ON WEB INTELLIGENCE (WI 2017), 2017, :356-364
[4]   Calibrating noise to sensitivity in private data analysis [J].
Dwork, Cynthia ;
McSherry, Frank ;
Nissim, Kobbi ;
Smith, Adam .
THEORY OF CRYPTOGRAPHY, PROCEEDINGS, 2006, 3876 :265-284
[5]   The Algorithmic Foundations of Differential Privacy [J].
Dwork, Cynthia ;
Roth, Aaron .
FOUNDATIONS AND TRENDS IN THEORETICAL COMPUTER SCIENCE, 2013, 9 (3-4) :211-406
[6]   Privacy-Preserving Data Aggregation in Smart Metering Systems [J].
Erkin, Zekeriya ;
Ramon Troncoso-Pastoriza, Juan ;
Lagendijk, R. L. ;
Perez-Gonzalez, Fernando .
IEEE SIGNAL PROCESSING MAGAZINE, 2013, 30 (02) :75-86
[7]   Ensuring privacy with constrained additive noise by minimizing Fisher information [J].
Farokhi, Farhad ;
Sandberg, Henrik .
AUTOMATICA, 2019, 99 :275-288
[8]  
Geng Q, 2020, PR MACH LEARN RES, V108, P89
[9]   Differentially Private Distributed Constrained Optimization [J].
Han, Shuo ;
Topcu, Ufuk ;
Pappas, George J. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (01) :50-64
[10]   Differential Private Noise Adding Mechanism and Its Application on Consensus Algorithm [J].
He, Jianping ;
Cai, Lin ;
Guan, Xinping .
IEEE TRANSACTIONS ON SIGNAL PROCESSING, 2020, 68 :4069-4082