Distributed mirror descent algorithm over unbalanced digraphs based on gradient weighting technique

被引:1
作者
Shi, Chong-Xiao [1 ]
Yang, Guang-Hong [1 ,2 ,3 ]
机构
[1] Northeastern Univ, Coll Informat Sci & Engn, Shenyang 110819, Peoples R China
[2] Northeastern Univ, State Key Lab Synthet Automat Proc Ind, Shenyang 110819, Liaoning, Peoples R China
[3] King Abdulaziz Univ, Dept Elect & Comp Engn, Jeddah 21589, Saudi Arabia
基金
中国国家自然科学基金;
关键词
ONLINE CONVEX-OPTIMIZATION; SUBGRADIENT METHODS; CONVERGENCE; CONSENSUS;
D O I
10.1016/j.jfranklin.2023.08.009
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
This paper studies the mirror descent algorithm for distributed optimization, where the underlying digraph is assumed to be weight-unbalanced. Within this framework, a novel distributed mirror descent algorithm based on gradient weighting technique is developed. Theoretically, different from the existing works, which prove that the function value corresponding to the estimates converge to the optimal value of the optimization problem, this paper proves that (1) the proposed algorithm can achieve exact convergence of the estimates to the solution of the optimization problem; and (2) the algorithm has a convergence rate O( 1 & RADIC;T ) with a given time horizon T . Further, taking into account the fact that the cost functions in many significant optimization problems are dynamic, the distributed online optimization based on the proposed algorithm is studied. Especially, it is shown that the individual regret of the proposed algorithm is bounded by O( & RADIC;T). Finally, the theoretical results are verified through some simulation examples. & COPY; 2023 The Franklin Institute. Published by Elsevier Inc. All rights reserved.
引用
收藏
页码:10656 / 10680
页数:25
相关论文
共 42 条
[1]   Distributed Online Convex Optimization on Time-Varying Directed Graphs [J].
Akbari, Mohammad ;
Gharesifard, Bahman ;
Linder, Tamas .
IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2017, 4 (03) :417-428
[2]  
[Anonymous], 2001, Studies in Computational Mathematics, DOI DOI 10.1016/S1570-579X(01)80004-5
[3]   Mirror descent and nonlinear projected subgradient methods for convex optimization [J].
Beck, A ;
Teboulle, M .
OPERATIONS RESEARCH LETTERS, 2003, 31 (03) :167-175
[4]   The ordered subsets mirror descent optimization method with applications to tomography [J].
Ben-Tal, A ;
Margalit, T ;
Nemirovski, A .
SIAM JOURNAL ON OPTIMIZATION, 2001, 12 (01) :79-108
[5]   Resilient practical cooperative output regulation for MASs with unknown switching exosystem dynamics under DoS attacks [J].
Deng, Chao ;
Zhang, Dan ;
Feng, Gang .
AUTOMATICA, 2022, 139
[6]   Convergence of the Iterates in Mirror Descent Methods [J].
Doan, Thinh T. ;
Bose, Subhonmesh ;
Nguyen, D. Hoa ;
Beck, Carolyn L. .
IEEE CONTROL SYSTEMS LETTERS, 2019, 3 (01) :114-119
[7]   Dual Averaging for Distributed Optimization: Convergence Analysis and Network Scaling [J].
Duchi, John C. ;
Agarwal, Alekh ;
Wainwright, Martin J. .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2012, 57 (03) :592-606
[8]  
Greg Droge H. K., 2014, Journal of Control and Decision, V1, P191, DOI [10.1080/23307706.2014.926622, DOI 10.1080/23307706.2014.926622]
[9]   Distributed Economic Dispatch for Smart Grids With Random Wind Power [J].
Guo, Fanghong ;
Wen, Changyun ;
Mao, Jianfeng ;
Song, Yong-Duan .
IEEE TRANSACTIONS ON SMART GRID, 2016, 7 (03) :1572-1583
[10]   Distributed Subgradient Method With Edge-Based Event-Triggered Communication [J].
Kajiyama, Yuichi ;
Hayashi, Naoki ;
Takai, Shigemasa .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2018, 63 (07) :2248-2255