A Primal-Dual Algorithm for Distributed Stochastic Optimization with Equality Constraints

被引:0
作者
Du, Kai-Xin [1 ]
Chen, Xing-Min [1 ]
机构
[1] Dalian Univ Technol, Sch Math Sci, Dalian 116024, Peoples R China
来源
2021 PROCEEDINGS OF THE 40TH CHINESE CONTROL CONFERENCE (CCC) | 2021年
关键词
distributed stochastic optimization; equality constrained optimization; distributed primal-dual algorithm; almost sure convergence; stochastic approximation; GRADIENT ALGORITHM; CONSENSUS; CONVERGENCE;
D O I
暂无
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
Distributed stochastic optimization problem with equality constraints over a random network with imperfect communications is considered, where the measurements of all functions to be used are subject to noises. The goal of the network is to minimize a global cost function subject to a global constraint set, where the global objective is a sum of objective functions, the global constraint set is the intersection of local constraint sets with equality constraints, and each agent only has access to information on its cost function and constraint function. A primal-dual projection-free distributed algorithm is proposed to solve the problem, where each agent updates its estimates by using the local observations and local information on its neighbors' broadcast state values. Almost sure convergence of the algorithm is proven under mild conditions.
引用
收藏
页码:5586 / 5591
页数:6
相关论文
共 22 条
[1]  
[Anonymous], 1971, OPTIMIZING METHODS S
[2]   Convergence of a Multi-Agent Projected Stochastic Gradient Algorithm for Non-Convex Optimization [J].
Bianchi, Pascal ;
Jakubowicz, Jeremie .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2013, 58 (02) :391-405
[3]   Distributed optimization and statistical learning via the alternating direction method of multipliers [J].
Boyd S. ;
Parikh N. ;
Chu E. ;
Peleato B. ;
Eckstein J. .
Foundations and Trends in Machine Learning, 2010, 3 (01) :1-122
[4]   Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling [J].
Duchi, John C. ;
Agarwal, Alekh ;
Wainwright, Martin J. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (03) :592-606
[5]  
Godsil C., 2001, Graduate Texts in Mathematics
[6]  
Khalil H. K., 2002, Nonlinear Systems, V115
[7]   ASYMPTOTIC PROPERTIES OF PRIMAL-DUAL ALGORITHM FOR DISTRIBUTED STOCHASTIC OPTIMIZATION OVER RANDOM NETWORKS WITH IMPERFECT COMMUNICATIONS [J].
Lei, Jinlong ;
Chen, Han-Fu ;
Fang, Hai-Tao .
SIAM JOURNAL ON CONTROL AND OPTIMIZATION, 2018, 56 (03) :2159-2188
[8]   Primal-dual algorithm for distributed constrained optimization [J].
Lei, Jinlong ;
Chen, Han-Fu ;
Fang, Hai-Tao .
SYSTEMS & CONTROL LETTERS, 2016, 96 :110-117
[9]  
Liu P., 2016, APPL COMPUTATIONAL M, V5, P114
[10]   Distributed Subgradient Methods for Convex Optimization Over Random Networks [J].
Lobel, Ilan ;
Ozdaglar, Asuman .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2011, 56 (06) :1291-1306