Discrete-Time Algorithms for Distributed Constrained Convex Optimization With Linear Convergence Rates

被引:31
作者
Liu, Hongzhe [1 ]
Yu, Wenwu [1 ]
Chen, Guanrong [2 ]
机构
[1] Southeast Univ, Sch Math, Nanjing 210096, Peoples R China
[2] City Univ Hong Kong, Dept Elect Engn, Hong Kong, Peoples R China
基金
中国国家自然科学基金;
关键词
Constraint; directed graph; distributed optimization; linear convergence rate; MULTIAGENT OPTIMIZATION; OPTIMAL CONSENSUS; SYSTEMS;
D O I
10.1109/TCYB.2020.3022240
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
In this article, the constrained optimization problem with its global objective function being the sum of convex local cost functions and the constraint being a closed convex set is researched. The aim of this study is to solve the researched problem in a distributed manner, that is, using only local computations and local information exchanges. Toward this end, two gradient-tracking-based distributed optimization algorithms are designed for the considered problem over weight-balanced and weight-unbalanced graphs, respectively. Since the classical projection method is unsuitable to handle the closed convex set constraint under the gradient-tracking framework, a new indirect projection method is employed in this article to deal with the involved closed convex set constraint. Furthermore, two time scales are introduced to complete the convergence analyses. In addition, under the condition that all local cost functions are strongly convex and L-smooth, it is proved that the algorithms with well-selected fixed step sizes have linear convergence rates.
引用
收藏
页码:4874 / 4885
页数:12
相关论文
共 40 条
[1]   Distributed Continuous-Time Convex Optimization on Weight-Balanced Digraphs [J].
Gharesifard, Bahman ;
Cortes, Jorge .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (03) :781-786
[2]   Distributed Convex Optimization on State-Dependent Undirected Graphs: Homogeneity Technique [J].
Hong, Huifen ;
Yu, Xinghuo ;
Yu, Wenwu ;
Zhang, Dong ;
Wen, Guanghui .
IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2020, 7 (01) :42-52
[3]  
Horn R. A., 2012, Matrix Analysis
[4]   Fast Distributed Gradient Methods [J].
Jakovetic, Dusan ;
Xavier, Joao ;
Moura, Jose M. F. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2014, 59 (05) :1131-1146
[5]   Distributed convex optimization via continuous-time coordination algorithms with discrete-time communication [J].
Kia, Solmaz S. ;
Cortes, Jorge ;
Martinez, Sonia .
AUTOMATICA, 2015, 55 :254-264
[6]   Primal-dual algorithm for distributed constrained optimization [J].
Lei, Jinlong ;
Chen, Han-Fu ;
Fang, Hai-Tao .
SYSTEMS & CONTROL LETTERS, 2016, 96 :110-117
[7]   Distributed Robust Algorithm for Economic Dispatch in Smart Grids Over General Unbalanced Directed Networks [J].
Li, Huaqing ;
Wang, Zheng ;
Chen, Guo ;
Dong, Zhao Yang .
IEEE TRANSACTIONS ON INDUSTRIAL INFORMATICS, 2020, 16 (07) :4322-4332
[8]   Convergence Analysis of a Distributed Optimization Algorithm with a General Unbalanced Directed Communication Network [J].
Li, Huaqing ;
Lu, Qingguo ;
Huang, Tingwen .
IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2019, 6 (03) :237-248
[9]   Distributed Continuous-Time Optimization: Nonuniform Gradient Gains, Finite-Time Convergence, and Convex Constraint Set [J].
Lin, Peng ;
Ren, Wei ;
Farrell, Jay A. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2017, 62 (05) :2239-2253
[10]  
Lin P, 2012, IEEE DECIS CONTR P, P6813, DOI 10.1109/CDC.2012.6425866