Distributed Mirror Descent Algorithm With Bregman Damping for Nonsmooth Constrained Optimization

被引:7
|
作者
Chen, Guanpu [1 ]
Xu, Gehui [1 ]
Li, Weijian [2 ]
Hong, Yiguang [3 ,4 ]
机构
[1] Chinese Acad Sci, Acad Math & Syst Sci, Key Lab Syst & Control, Beijing 100190, Peoples R China
[2] DAMO Acad, Alibaba Grp, Decis Intelligence Lab, Hangzhou 310052, Peoples R China
[3] Tongji Univ, Dept Control Sci & Engn, Shanghai 210201, Peoples R China
[4] Tongji Univ, Shanghai Res Inst Intelligent Autonomous Syst, Shanghai 210201, Peoples R China
基金
中国国家自然科学基金;
关键词
Constrained optimization; distributed algorithm; mirror descent; multi-agent system; nonsmooth; CONVERGENCE ANALYSIS; ECONOMIC-DISPATCH; CONSENSUS;
D O I
10.1109/TAC.2023.3244995
中图分类号
TP [自动化技术、计算机技术];
学科分类号
0812 ;
摘要
To efficiently solve the nonsmooth distributed optimization with both local constraints and coupled constraints, we propose a distributed continuous-time algorithm based on the mirror descent (MD) method. In this article, we introduce the Bregman damping into distributed MD-based dynamics, which not only successfully applies the MD idea to the distributed primal-dual framework, but also ensures the boundedness of all variables and the convergence of the entire dynamics. Our approach generalizes the classic distributed projection-based dynamics, and establishes a connection between MD methods and distributed Euclidean-projected approaches. Also, we prove the convergence of the proposed distributed dynamics with an O(1/t) rate. For practical implementation, we further give a discrete-time algorithm based on the proposed dynamics with an O(1/root k) convergence rate.
引用
收藏
页码:6921 / 6928
页数:8
相关论文
共 50 条
  • [1] Distributed Randomized Gradient-Free Mirror Descent Algorithm for Constrained Optimization
    Yu, Zhan
    Ho, Daniel W. C.
    Yuan, Deming
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2022, 67 (02) : 957 - 964
  • [2] A Weighted Mirror Descent Algorithm for Nonsmooth Convex Optimization Problem
    Duy V. N. Luong
    Panos Parpas
    Daniel Rueckert
    Berç Rustem
    Journal of Optimization Theory and Applications, 2016, 170 : 900 - 915
  • [3] A Weighted Mirror Descent Algorithm for Nonsmooth Convex Optimization Problem
    Luong, Duy V. N.
    Parpas, Panos
    Rueckert, Daniel
    Rustem, Berc
    JOURNAL OF OPTIMIZATION THEORY AND APPLICATIONS, 2016, 170 (03) : 900 - 915
  • [4] An alternating structure-adapted Bregman proximal gradient descent algorithm for constrained nonconvex nonsmooth optimization problems and its inertial variant
    Gao, Xue
    Cai, Xingju
    Wang, Xiangfeng
    Han, Deren
    JOURNAL OF GLOBAL OPTIMIZATION, 2023, 87 (01) : 277 - 300
  • [5] An alternating structure-adapted Bregman proximal gradient descent algorithm for constrained nonconvex nonsmooth optimization problems and its inertial variant
    Xue Gao
    Xingju Cai
    Xiangfeng Wang
    Deren Han
    Journal of Global Optimization, 2023, 87 : 277 - 300
  • [6] A Distributed Continuous-Time Algorithm for Nonsmooth Constrained Optimization
    Chen, Gang
    Yang, Qing
    Song, Yongduan
    Lewis, Frank L.
    IEEE TRANSACTIONS ON AUTOMATIC CONTROL, 2020, 65 (11) : 4914 - 4921
  • [7] Gossip-based distributed stochastic mirror descent for constrained optimization
    Fang, Xianju
    Zhang, Baoyong
    Yuan, Deming
    NEURAL NETWORKS, 2024, 175
  • [8] Adaptive Mirror Descent for Constrained Optimization
    Bayandina, Anastasia
    2017 CONSTRUCTIVE NONSMOOTH ANALYSIS AND RELATED TOPICS (DEDICATED TO THE MEMORY OF V.F. DEMYANOV) (CNSA), 2017, : 36 - 39
  • [9] Distributed Communication-Sliding Mirror-Descent Algorithm for Nonsmooth Resource Allocation Problem
    Wang Yinghui
    Tu Zhipeng
    Qin Huashu
    JOURNAL OF SYSTEMS SCIENCE & COMPLEXITY, 2022, 35 (04) : 1244 - 1261
  • [10] Distributed Communication-Sliding Mirror-Descent Algorithm for Nonsmooth Resource Allocation Problem
    Yinghui Wang
    Zhipeng Tu
    Huashu Qin
    Journal of Systems Science and Complexity, 2022, 35 : 1244 - 1261