Distributed Mirror Descent Algorithm With Bregman Damping for Nonsmooth Constrained Optimization

被引:7
|
作者
Chen, Guanpu [1 ]
Xu, Gehui [1 ]
Li, Weijian [2 ]
Hong, Yiguang [3 ,4 ]
机构
[1] Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
[2] DAMO Acad, Alibaba Grp, Decis Intelligence Lab, Hangzhou 310052, Peoples R China
[3] Tongji Univ, Dept Control Sci & Engn, Shanghai 210201, Peoples R China
[4] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai 210201, Peoples R China
基金
中国国家自然科学基金;
关键词
Constrained optimization; distributed algorithm; mirror descent; multi-agent system; nonsmooth; CONVERGENCE ANALYSIS; ECONOMIC-DISPATCH; CONSENSUS;
D O I
10.1109/TAC.2023.3244995
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To efficiently solve the nonsmooth distributed optimization with both local constraints and coupled constraints, we propose a distributed continuous-time algorithm based on the mirror descent (MD) method. In this article, we introduce the Bregman damping into distributed MD-based dynamics, which not only successfully applies the MD idea to the distributed primal-dual framework, but also ensures the boundedness of all variables and the convergence of the entire dynamics. Our approach generalizes the classic distributed projection-based dynamics, and establishes a connection between MD methods and distributed Euclidean-projected approaches. Also, we prove the convergence of the proposed distributed dynamics with an O(1/t) rate. For practical implementation, we further give a discrete-time algorithm based on the proposed dynamics with an O(1/root k) convergence rate.
引用
收藏
页码:6921 / 6928
页数:8
相关论文
共 50 条
  • [21] Extrapolated Smoothing Descent Algorithm for Constrained Nonconvex and Nonsmooth Composite Problems
    Chen, Yunmei
    Liu, Hongcheng
    Wang, Weina
    CHINESE ANNALS OF MATHEMATICS SERIES B, 2022, 43 (06) : 1049 - 1070
  • [22] Extrapolated Smoothing Descent Algorithm for Constrained Nonconvex and Nonsmooth Composite Problems
    Yunmei Chen
    Hongcheng Liu
    Weina Wang
    Chinese Annals of Mathematics, Series B, 2022, 43 : 1049 - 1070
  • [23] Extrapolated Smoothing Descent Algorithm for Constrained Nonconvex and Nonsmooth Composite Problems
    Yunmei CHEN
    Hongcheng LIU
    Weina WANG
    Chinese Annals of Mathematics,Series B, 2022, (06) : 1049 - 1070
  • [24] Differentially private distributed online mirror descent algorithm
    Yuan, Meng
    Lei, Jinlong
    Hong, Yiguang
    NEUROCOMPUTING, 2023, 551
  • [25] A trust region algorithm for constrained nonsmooth optimization problems
    Yang, YF
    Li, DH
    JOURNAL OF COMPUTATIONAL MATHEMATICS, 2001, 19 (04) : 357 - 364
  • [27] Distributed Smoothing Projection Neurodynamic Approaches for Constrained Nonsmooth Optimization
    Zhao, You
    Liao, Xiaofeng
    He, Xing
    IEEE TRANSACTIONS ON SYSTEMS MAN CYBERNETICS-SYSTEMS, 2023, 53 (02): : 675 - 688
  • [28] A Distributed Network System for Nonsmooth Coupled-Constrained Optimization
    Wang, Xiaoxuan
    Yang, Shaofu
    Guo, Zhenyuan
    Wen, Shiping
    Huang, Tingwen
    IEEE TRANSACTIONS ON NETWORK SCIENCE AND ENGINEERING, 2022, 9 (05): : 3691 - 3700
  • [29] Bregman distance regularization for nonsmooth and nonconvex optimization
    Mashreghi, Zeinab
    Nasri, Mostafa
    CANADIAN MATHEMATICAL BULLETIN-BULLETIN CANADIEN DE MATHEMATIQUES, 2024, 67 (02): : 415 - 424
  • [30] Distributed stochastic mirror descent algorithm for resource allocation problem
    Wang, Yinghui
    Tu, Zhipeng
    Qin, Huashu
    CONTROL THEORY AND TECHNOLOGY, 2020, 18 (04) : 339 - 347