Distributed Mirror Descent Algorithm With Bregman Damping for Nonsmooth Constrained Optimization

被引:9
作者
Chen, Guanpu [1 ]
Xu, Gehui [1 ]
Li, Weijian [2 ]
Hong, Yiguang [3 ,4 ]
机构
[1] Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
[2] DAMO Acad, Alibaba Grp, Decis Intelligence Lab, Hangzhou 310052, Peoples R China
[3] Tongji Univ, Dept Control Sci & Engn, Shanghai 210201, Peoples R China
[4] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai 210201, Peoples R China
基金
中国国家自然科学基金;
关键词
Constrained optimization; distributed algorithm; mirror descent; multi-agent system; nonsmooth; CONVERGENCE ANALYSIS; ECONOMIC-DISPATCH; CONSENSUS;
D O I
10.1109/TAC.2023.3244995
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To efficiently solve the nonsmooth distributed optimization with both local constraints and coupled constraints, we propose a distributed continuous-time algorithm based on the mirror descent (MD) method. In this article, we introduce the Bregman damping into distributed MD-based dynamics, which not only successfully applies the MD idea to the distributed primal-dual framework, but also ensures the boundedness of all variables and the convergence of the entire dynamics. Our approach generalizes the classic distributed projection-based dynamics, and establishes a connection between MD methods and distributed Euclidean-projected approaches. Also, we prove the convergence of the proposed distributed dynamics with an O(1/t) rate. For practical implementation, we further give a discrete-time algorithm based on the proposed dynamics with an O(1/root k) convergence rate.
引用
收藏
页码:6921 / 6928
页数:8
相关论文
共 50 条
[41]   Accelerated Projection Algorithm Based on Smoothing Approximation for Distributed Nonsmooth Optimization [J].
Zhao, You ;
Liao, Xiaofeng ;
He, Xing .
IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2023, 10 (04) :1682-1694
[42]   A Smooth Double Proximal Primal-Dual Algorithm for a Class of Distributed Nonsmooth Optimization Problems [J].
Wei, Yue ;
Fang, Hao ;
Zeng, Xianlin ;
Chen, Jie ;
Pardalos, Panos .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (04) :1800-1806
[43]   Primal-dual algorithm for distributed constrained optimization [J].
Lei, Jinlong ;
Chen, Han-Fu ;
Fang, Hai-Tao .
SYSTEMS & CONTROL LETTERS, 2016, 96 :110-117
[44]   Asynchronous distributed algorithm for constrained optimization and its application [J].
Wang, Ting ;
Li, Zhongmei ;
Nie, Rong ;
Du, Wenli .
SCIENCE CHINA-TECHNOLOGICAL SCIENCES, 2025, 68 (06)
[45]   RLC Circuits-Based Distributed Mirror Descent Method [J].
Yu, Yue ;
Acikmese, Behcet .
IEEE CONTROL SYSTEMS LETTERS, 2020, 4 (03) :548-553
[46]   Distributed mirror descent algorithm over unbalanced digraphs based on gradient weighting technique [J].
Shi, Chong-Xiao ;
Yang, Guang-Hong .
JOURNAL OF THE FRANKLIN INSTITUTE, 2023, 360 (14) :10656-10680
[47]   Distributed Algorithm Design for Nonsmooth Resource Allocation Problems [J].
Deng, Zhenhua ;
Nian, Xiaohong ;
Hu, Chen .
IEEE TRANSACTIONS ON CYBERNETICS, 2020, 50 (07) :3208-3217
[48]   Distributed Continuous-Time Gradient-Based Algorithm for Constrained Optimization [J].
Yi, Peng ;
Hong, Yiguang .
2014 33RD CHINESE CONTROL CONFERENCE (CCC), 2014, :1563-1567
[49]   Gradient-free method for nonsmooth distributed optimization [J].
Li, Jueyou ;
Wu, Changzhi ;
Wu, Zhiyou ;
Long, Qiang .
JOURNAL OF GLOBAL OPTIMIZATION, 2015, 61 (02) :325-340
[50]   Distributed continuous-time algorithm for a general nonsmooth monotropic optimization problem [J].
Li, Xiuxian ;
Xie, Lihua ;
Hong, Yiguang .
INTERNATIONAL JOURNAL OF ROBUST AND NONLINEAR CONTROL, 2019, 29 (10) :3252-3266