Differential Privacy of Online Distributed Optimization under Adversarial Nodes

被引:0
作者
Hou, Ming [1 ]
Li, Dequan [1 ]
Wu, Xiongjun [2 ]
Shen, Xiuyu [1 ]
机构
[1] Anhui Univ Sci & Technol, Sch Math & Big Data, Huainan 232001, Anhui, Peoples R China
[2] China Aerosp Sci & Technol Corp, Natl Def Key Lab Sci & Technol Electromagnet Scat, Inst 802, Shanghai Acad Space Flight Technol,Acad 8, Shanghai 201109, Peoples R China
来源
PROCEEDINGS OF THE 38TH CHINESE CONTROL CONFERENCE (CCC) | 2019年
基金
国家重点研发计划;
关键词
Differential privacy; Distributed optimization; Online learning; Adversarial;
D O I
10.23919/chicc.2019.8865820
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Nowadays, many applications involve big data and big data analysis methods appear in many fields. As a preliminary attempt to solve the challenge of big data analysis, this paper presents a distributed online learning algorithm based on differential privacy. Since online learning can effectively process sensitive data, we introduce the concept of differential privacy in distributed online learning algorithms, with the aim at ensuring data privacy during online learning to prevent adversarial nodes from inferring any important data information. In particular, for different adversary models, we consider different type graphs to tolerate a limited number of adversaries near each regular node or tolerate a global limited number of adversaries.
引用
收藏
页码:2172 / 2177
页数:6
相关论文
共 27 条
[1]   Private Empirical Risk Minimization: Efficient Algorithms and Tight Error Bounds [J].
Bassily, Raef ;
Smith, Adam ;
Thakurta, Abhradeep .
2014 55TH ANNUAL IEEE SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE (FOCS 2014), 2014, :464-473
[2]  
Chaudhuri K, 2011, J MACH LEARN RES, V12, P1069
[3]  
Dwork C., 2006, Encyclopedia of Cryptography and Security, P1
[4]   Calibrating noise to sensitivity in private data analysis [J].
Dwork, Cynthia ;
McSherry, Frank ;
Nissim, Kobbi ;
Smith, Adam .
THEORY OF CRYPTOGRAPHY, PROCEEDINGS, 2006, 3876 :265-284
[5]   Boosting and Differential Privacy [J].
Dwork, Cynthia ;
Rothblum, Guy N. ;
Vadhan, Salil .
2010 IEEE 51ST ANNUAL SYMPOSIUM ON FOUNDATIONS OF COMPUTER SCIENCE, 2010, :51-60
[6]   Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs [J].
Gharesifard, Bahman ;
Cortes, Jorge .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (03) :781-786
[7]   Differentially Private Distributed Optimization [J].
Huang, Zhenqi ;
Mitra, Sayan ;
Vaidya, Nitin .
PROCEEDINGS OF THE 16TH INTERNATIONAL CONFERENCE ON DISTRIBUTED COMPUTING AND NETWORKING, 2015,
[8]  
Jing Wang, 2010, 2010 48th Annual Allerton Conference on Communication, Control, and Computing (Allerton), P557, DOI 10.1109/ALLERTON.2010.5706956
[9]   A RANDOMIZED INCREMENTAL SUBGRADIENT METHOD FOR DISTRIBUTED OPTIMIZATION IN NETWORKED SYSTEMS [J].
Johansson, Bjorn ;
Rabi, Maben ;
Johansson, Mikael .
SIAM JOURNAL ON OPTIMIZATION, 2009, 20 (03) :1157-1170
[10]  
Kusner MJ, 2015, PR MACH LEARN RES, V37, P918