Distributed Mirror Descent Algorithm With Bregman Damping for Nonsmooth Constrained Optimization

被引:9
作者
Chen, Guanpu [1 ]
Xu, Gehui [1 ]
Li, Weijian [2 ]
Hong, Yiguang [3 ,4 ]
机构
[1] Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
[2] DAMO Acad, Alibaba Grp, Decis Intelligence Lab, Hangzhou 310052, Peoples R China
[3] Tongji Univ, Dept Control Sci & Engn, Shanghai 210201, Peoples R China
[4] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai 210201, Peoples R China
基金
中国国家自然科学基金;
关键词
Constrained optimization; distributed algorithm; mirror descent; multi-agent system; nonsmooth; CONVERGENCE ANALYSIS; ECONOMIC-DISPATCH; CONSENSUS;
D O I
10.1109/TAC.2023.3244995
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To efficiently solve the nonsmooth distributed optimization with both local constraints and coupled constraints, we propose a distributed continuous-time algorithm based on the mirror descent (MD) method. In this article, we introduce the Bregman damping into distributed MD-based dynamics, which not only successfully applies the MD idea to the distributed primal-dual framework, but also ensures the boundedness of all variables and the convergence of the entire dynamics. Our approach generalizes the classic distributed projection-based dynamics, and establishes a connection between MD methods and distributed Euclidean-projected approaches. Also, we prove the convergence of the proposed distributed dynamics with an O(1/t) rate. For practical implementation, we further give a discrete-time algorithm based on the proposed dynamics with an O(1/root k) convergence rate.
引用
收藏
页码:6921 / 6928
页数:8
相关论文
共 50 条
[31]   Broadcast-based asynchronous convex optimization using quantized distributed stochastic mirror descent algorithm [J].
Fang, Xianju ;
Zhang, Baoyong ;
Yuan, Deming ;
Liu, Honglei ;
Song, Bo .
SYSTEMS & CONTROL LETTERS, 2025, 203
[32]   Quantizer-based distributed mirror descent for multi-agent convex optimization [J].
Xiong, Menghui ;
Zhang, Baoyong ;
Yuan, Deming .
PROCEEDINGS OF THE 33RD CHINESE CONTROL AND DECISION CONFERENCE (CCDC 2021), 2021, :3485-3490
[33]   Taming Nonconvex Stochastic Mirror Descent with General Bregman Divergence [J].
Fatkhullin, Ilyas ;
He, Niao .
INTERNATIONAL CONFERENCE ON ARTIFICIAL INTELLIGENCE AND STATISTICS, VOL 238, 2024, 238
[34]   Fully Distributed Algorithms for Constrained Nonsmooth Optimization Problems of General Linear Multiagent Systems and Their Application [J].
Deng, Zhenhua ;
Luo, Jin .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2024, 69 (02) :1377-1384
[35]   Event-Triggered Distributed Stochastic Mirror Descent for Convex Optimization [J].
Xiong, Menghui ;
Zhang, Baoyong ;
Ho, Daniel W. C. ;
Yuan, Deming ;
Xu, Shengyuan .
IEEE TRANSACTIONS ON NEURAL NETWORKS AND LEARNING SYSTEMS, 2023, 34 (09) :6480-6491
[36]   Quantized Gradient Descent Algorithm for Distributed Nonconvex Optimization [J].
Yoshida, Junya ;
Hayashi, Naoki ;
Takai, Shigemasa .
IEICE TRANSACTIONS ON FUNDAMENTALS OF ELECTRONICS COMMUNICATIONS AND COMPUTER SCIENCES, 2023, E106A (10) :1297-1304
[37]   Distributed Constrained Optimization Algorithm Equipped with Nabla Fractional Dynamics [J].
Zhou, Shuaiyu ;
Hong, Xiaolin ;
Ni, Xintong ;
Wei, Yiheng .
ADVANCES IN GUIDANCE, NAVIGATION AND CONTROL, VOL 6, 2025, 1342 :437-445
[38]   Stochastic Bregman Subgradient Methods for Nonsmooth Nonconvex Optimization Problems [J].
Ding, Kuangyu ;
Toh, Kim-Chuan .
JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2025, 206 (03)
[39]   Distributed Multiproximal Algorithm for Nonsmooth Convex Optimization With Coupled Inequality Constraints [J].
Huang, Yi ;
Meng, Ziyang ;
Sun, Jian ;
Ren, Wei .
IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2023, 68 (12) :8126-8133
[40]   Distributed Continuous-Time Algorithm for Constrained Optimization of Networked Euler-Lagrange Systems [J].
Zou, Yao ;
Huang, Bomin ;
Meng, Ziyang .
IEEE TRANSACTIONS ON CONTROL OF NETWORK SYSTEMS, 2021, 8 (02) :1034-1042